Modelpublic

MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_PTQ_W8A8

sourceHugging Faceupdated 6mo agoView on Hugging Face

0likes56downloads

Model Card

Compressed Model: MilyaShams/Qwen3-1.7B-SmoothQuant0.5PTQ_W8A8

This model was compressed using the llmcompressor framework.

Compression Details

—Base Model: Qwen/Qwen3-1.7B
—Experiment Name: SmoothQuant0.5PTQ_W8A8
—Recipe / Modifiers Applied:

python

[SmoothQuantModifier(index=None, group=None, start=None, end=None, update=None, initialized_=True, finalized_=True, started_=True, ended_=True, smoothing_strength=0.5, mappings=[LayerMap(balance_layers=['re:.*q_proj', 're:.*k_proj', 're:.*v_proj'], smooth_layers='re:.*input_layernorm'), LayerMap(balance_layers=['re:.*gate_proj', 're:.*up_proj'], smooth_layers='re:.*post_attention_layernorm')], ignore=[], num_calibration_steps=None, calibration_function=None), QuantizationModifier(config_groups=None, targets=['Linear'], ignore=[], scheme='W8A8', kv_cache_scheme=None, weight_observer=None, input_observer=None, output_observer=None, observer=None, bypass_divisibility_checks=False, index=None, group=None, start=None, end=None, update=None, initialized_=True, finalized_=None, started_=True, ended_=True)]

Note: This model card was automatically generated. All structural modifiers and parameters used during compression are logged above.