CoolFace
Modelpublic

mradermacher/vicuna-7b-v1.3-attention-sparsity-20-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes142downloads
root
file.gitattributes2 KBdownload
fileREADME.md4 KBdownload
filevicuna-7b-v1.3-attention-sparsity-20.f16.gguf12.55 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.IQ4_XS.gguf3.40 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q2_K.gguf2.36 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q3_K_L.gguf3.35 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q3_K_M.gguf3.07 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q3_K_S.gguf2.75 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q4_K_M.gguf3.80 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q4_K_S.gguf3.59 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q5_K_M.gguf4.45 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q5_K_S.gguf4.33 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q6_K.gguf5.15 GBdownload
filevicuna-7b-v1.3-attention-sparsity-20.Q8_0.gguf6.67 GBdownload

mradermacher/vicuna-7b-v1.3-attention-sparsity-20-GGUF · main · files are served by the source, never re-hosted here