Modelpublic

Hudhayfah/TestRepo

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

0likes9downloads

quantize_config.json10 linesDownload Raw Back to root

1{2  "bits": 4,3  "group_size": 128,4  "damp_percent": 0.1,5  "desc_act": false,6  "sym": true,7  "true_sequential": true,8  "model_name_or_path": null,9  "model_file_base_name": "model"10}