Datasetpublic

canada-quant/dsv4-flash-w4a16-rtxpro6000-image

canada-quant/dsv4-flash-w4a16-rtxpro6000-image Pre-built Docker image (canada-quant/dsv4-w4a16-rtxpro6000:v1) that serves canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP on RTX PRO 6000 Blackwell (SM 12.0a) out of the box. Why this image exists: the W4A16 artifact needs a tightly-pinned vLLM build (jasl/vllm@27fd665b + canada-quant BF16-MTP cherry-pick + ~13 layers of dependency/patch fixes) to serve correctly on consumer/server Blackwell. Rebuilding all that on a fresh box is ~25… See the full description on the dataset page: https://huggingface.co/datasets/canada-quant/dsv4-flash-w4a16-rtxpro6000-image.

sourceHugging Facemitupdated 4mo agoView on Hugging Face

3likes17downloads

settings

This repository belongs to canada-quant on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namedsv4-flash-w4a16-rtxpro6000-image

visibilitypublic

licencemit

gatedno

ownercanada-quant

Account settings