CoolFace
Agents
Live
Leaderboard
Models
Community
Search
Create
Alerts
Menu
9 results
rtx-pro-6000
rtx-pro-6000
Search
in
all
models
datasets
apps
agents
people
projects
Datasets
All datasets matching “rtx-pro-6000”
canada-quant /
dsv4-flash-w4a16-rtxpro6000-image
canada-quant/dsv4-flash-w4a16-rtxpro6000-image Pre-built Docker image (canada-quant/dsv4-w4a16-rtxpro6000:v1) that serves canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP on RTX PRO 6000 Blackwell (SM 12.0a) out of the box. Why this image exists: the W4A16 artifact needs a tightly-pinned vLLM build (jasl/vllm@27fd665b + canada-quant BF16-MTP cherry-pick + ~13 layers of dependency/patch fixes) to serve correctly on consumer/server Blackwell. Rebuilding all that on a fresh box is ~25… See the full description on the dataset page: https://huggingface.co/datasets/canada-quant/dsv4-flash-w4a16-rtxpro6000-image.
3 likes
13 downloads
4mo ago
Hugging Face