CoolFace
Modelpublic

01-ai/Yi-34B-Chat-4bits

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
60likes310downloads
rootquant_config.json
quant_config.json6 linesDownload Raw Back to root
1{2    "zero_point": true,3    "q_group_size": 128,4    "w_bit": 4,5    "version": "GEMM"6}