CoolFace
Modelpublic

RichardErkhov/wang7776_-_vicuna-7b-v1.3-attention-sparsity-10-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes135downloads
root
file.gitattributes3 KBdownload
filevicuna-7b-v1.3-attention-sparsity-10.IQ3_M.gguf2.90 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.IQ3_S.gguf2.75 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.IQ3_XS.gguf2.60 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.IQ4_NL.gguf3.58 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.IQ4_XS.gguf3.40 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q2_K.gguf2.36 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q3_K_L.gguf3.35 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q3_K_M.gguf3.07 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q3_K_S.gguf2.75 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q3_K.gguf3.07 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q4_0.gguf3.56 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q4_K_M.gguf3.80 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q4_K_S.gguf3.59 GBdownload
filevicuna-7b-v1.3-attention-sparsity-10.Q4_K.gguf3.80 GBdownload

RichardErkhov/wang7776_-_vicuna-7b-v1.3-attention-sparsity-10-gguf · main · files are served by the source, never re-hosted here