Modelpublic

ModelCloud/TinyLlama-1.1B-Chat-v1.0-GPTQ-4bit-sharded

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes35downloads

Model Card

—bits: 4,
—group_size: 128,
—desc_act: true,
—static_groups: false,
—sym: true,
—lm_head: false,
—damp_percent: 0.01,
—true_sequential: true,
—model_name_or_path: ,
—model_file_base_name: model,
—quant_method: gptq,
—checkpoint_format: gptq,
—meta:
—quantizer: gptqmodel:0.9.9-dev0