CoolFace
Modelpublic

Mungert/functionary-small-v3.1-GGUF

sourceHugging Facemitupdated 1y agoView on Hugging Face
3likes1.7kdownloads
root
file.gitattributes5 KBdownload
filefunctionary-small-v3.1-bf16-q4_k.gguf5.86 GBdownload
filefunctionary-small-v3.1-bf16-q6_k.gguf7.30 GBdownload
filefunctionary-small-v3.1-bf16-q8_0.gguf8.87 GBdownload
filefunctionary-small-v3.1-bf16.gguf14.97 GBdownload
filefunctionary-small-v3.1-f16-q4_k.gguf5.86 GBdownload
filefunctionary-small-v3.1-f16-q6_k.gguf7.30 GBdownload
filefunctionary-small-v3.1-f16-q8_0.gguf8.87 GBdownload
filefunctionary-small-v3.1-iq1_m.gguf2.01 GBdownload
filefunctionary-small-v3.1-iq1_s.gguf1.88 GBdownload
filefunctionary-small-v3.1-iq2_m.gguf2.75 GBdownload
filefunctionary-small-v3.1-iq2_s.gguf2.57 GBdownload
filefunctionary-small-v3.1-iq2_xs.gguf2.43 GBdownload
filefunctionary-small-v3.1-iq2_xxs.gguf2.23 GBdownload
filefunctionary-small-v3.1-iq3_m.gguf3.52 GBdownload
filefunctionary-small-v3.1-iq3_s.gguf3.43 GBdownload
filefunctionary-small-v3.1-iq3_xs.gguf3.28 GBdownload
filefunctionary-small-v3.1-iq3_xxs.gguf3.05 GBdownload
filefunctionary-small-v3.1-iq4_nl.gguf4.36 GBdownload
filefunctionary-small-v3.1-iq4_xs.gguf4.14 GBdownload
filefunctionary-small-v3.1-q2_k_s.gguf2.78 GBdownload
filefunctionary-small-v3.1-q3_k_m.gguf3.74 GBdownload
filefunctionary-small-v3.1-q3_k_s.gguf3.41 GBdownload
filefunctionary-small-v3.1-q4_0.gguf4.21 GBdownload
filefunctionary-small-v3.1-q4_1.gguf4.68 GBdownload
filefunctionary-small-v3.1-q4_k_m.gguf4.58 GBdownload
filefunctionary-small-v3.1-q4_k_s.gguf4.37 GBdownload
filefunctionary-small-v3.1-q5_0.gguf5.15 GBdownload
filefunctionary-small-v3.1-q5_1.gguf5.62 GBdownload
filefunctionary-small-v3.1-q5_k_m.gguf5.34 GBdownload
filefunctionary-small-v3.1-q5_k_s.gguf5.21 GBdownload
filefunctionary-small-v3.1-q6_k_m.gguf6.14 GBdownload
filefunctionary-small-v3.1-q8_0.gguf7.95 GBdownload
filefunctionary-small-v3.1-tq1_0.gguf2.06 GBdownload
filefunctionary-small-v3.1-tq2_0.gguf2.36 GBdownload
filefunctionary-small-v3.1.imatrix4.8 MBdownload
fileREADME.md14 KBdownload

Mungert/functionary-small-v3.1-GGUF · main · files are served by the source, never re-hosted here