CoolFace
Datasetpublic

EXD-AI/vllm-configs

EXD vLLM Config Profiles Production configuration profiles for the config-driven serve harness at projects/serve/. Usage On atom (GPU machine): cd ~/EXD ./scripts/up.sh <config-name> Profiles Config Model Notes qwen2.5-7b Qwen 2.5 7B Instruct Baseline 7B qwen3.6-27b Qwen 3.6 27B Mid-size qwen3.6-35b-a3b Qwen 3.6 35B A3B MoE baseline qwen3.6-35b-a3b-baseline Qwen 3.6 35B A3B Baseline sweep qwen3.6-35b-a3b-mtp0 Qwen 3.6 35B A3B MTP… See the full description on the dataset page: https://huggingface.co/datasets/EXD-AI/vllm-configs.

sourceHugging Facemitupdated 3mo agoView on Hugging Face
0likes265downloads
Dataset Card

EXD vLLM Config Profiles

Production configuration profiles for the config-driven serve harness at projects/serve/.

Usage

On atom (GPU machine):

bash
cd ~/EXD
./scripts/up.sh <config-name>

Profiles

ConfigModelNotes
qwen2.5-7bQwen 2.5 7B InstructBaseline 7B
qwen3.6-27bQwen 3.6 27BMid-size
qwen3.6-35b-a3bQwen 3.6 35B A3BMoE baseline
qwen3.6-35b-a3b-baselineQwen 3.6 35B A3BBaseline sweep
qwen3.6-35b-a3b-mtp0Qwen 3.6 35B A3BMTP depth 0
qwen3.6-35b-a3b-mtp3Qwen 3.6 35B A3BMTP depth 3
qwen3.6-35b-a3b-throughputQwen 3.6 35B A3BThroughput-optimized
nemotron-3-superNemotron 3 SuperLarge run

Related