Modelpublic

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-numinamath-cot-train-w4a16-g128-n256-s1024

sourceHugging Faceupdated 3mo agoView on Hugging Face

0likes6downloads

Model Card

Qwen3-4B-Thinking-2507-llmc-awq-calib-numinamath-cot-train-w4a16-g128-n256-s1024

Base model: Qwen/Qwen3-4B-Thinking-2507

Quantized with llm-compressor.

—method: awq
—weight format: W4A16
—group size: 128
—calibration dataset: AI-MO/NuminaMath-CoT
—calibration dataset config: ``
—calibration split: train
—calibration samples: 256
—max sequence length: 1024