CoolFace
Modelpublic

meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-c4-en-train-w4a16-g128-n256-s1024

sourceHugging Faceupdated 3mo agoView on Hugging Face
0likes7downloads
Model Card

Qwen3-4B-Thinking-2507-llmc-awq-calib-c4-en-train-w4a16-g128-n256-s1024

Base model: Qwen/Qwen3-4B-Thinking-2507

Quantized with llm-compressor.

  • —method: awq
  • —weight format: W4A16
  • —group size: 128
  • —calibration dataset: allenai/c4
  • —calibration dataset config: en
  • —calibration split: train
  • —calibration samples: 256
  • —max sequence length: 1024