CoolFace
Modelpublic

TheBloke/deepseek-coder-6.7B-instruct-AWQ

sourceHugging Faceotherupdated 3y agoView on Hugging Face
19likes410downloads
rootquant_config.json
quant_config.json6 linesDownload Raw Back to root
1{2    "zero_point": true,3    "q_group_size": 128,4    "w_bit": 4,5    "version": "GEMM"6}