meteorain/Qwen3-4B-Thinking-2507-llmc-awq-calib-c4-en-train-w4a16-g128-n256-s1024
07
Qwen3-4B-Thinking-2507-llmc-awq-calib-c4-en-train-w4a16-g128-n256-s1024
Base model: Qwen/Qwen3-4B-Thinking-2507
Quantized with llm-compressor.
- method:
awq - weight format:
W4A16 - group size:
128 - calibration dataset:
allenai/c4 - calibration dataset config:
en - calibration split:
train - calibration samples:
256 - max sequence length:
1024
