CoolFace
Modelpublic

doubledsbv/ALMA-13B-R-AWQ

sourceHugging Faceupdated 3y agoView on Hugging Face
1likes19downloads
quant_config.json7 linesDownload Raw Back to root
1{2    "zero_point": true,3    "q_group_size": 128,4    "w_bit": 4,5    "version": "GEMM",6    "modules_to_not_convert": null7}