canada-quant/dsv4-flash-w4a16-rtxpro6000-image
canada-quant/dsv4-flash-w4a16-rtxpro6000-image Pre-built Docker image (canada-quant/dsv4-w4a16-rtxpro6000:v1) that serves canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP on RTX PRO 6000 Blackwell (SM 12.0a) out of the box. Why this image exists: the W4A16 artifact needs a tightly-pinned vLLM build (jasl/vllm@27fd665b + canada-quant BF16-MTP cherry-pick + ~13 layers of dependency/patch fixes) to serve correctly on consumer/server Blackwell. Rebuilding all that on a fresh box is ~25… See the full description on the dataset page: https://huggingface.co/datasets/canada-quant/dsv4-flash-w4a16-rtxpro6000-image.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face