Modelpublic

mradermacher/functionary-7b-v2.1-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

1likes2kdownloads

filefunctionary-7b-v2.1.f16.gguf13.49 GBdownload

filefunctionary-7b-v2.1.IQ3_M.gguf3.06 GBdownload

filefunctionary-7b-v2.1.IQ3_S.gguf2.96 GBdownload

filefunctionary-7b-v2.1.IQ3_XS.gguf2.81 GBdownload

filefunctionary-7b-v2.1.IQ4_XS.gguf3.67 GBdownload

filefunctionary-7b-v2.1.Q2_K.gguf2.53 GBdownload

filefunctionary-7b-v2.1.Q3_K_L.gguf3.56 GBdownload

filefunctionary-7b-v2.1.Q3_K_M.gguf3.28 GBdownload

filefunctionary-7b-v2.1.Q3_K_S.gguf2.95 GBdownload

filefunctionary-7b-v2.1.Q4_K_M.gguf4.07 GBdownload

filefunctionary-7b-v2.1.Q4_K_S.gguf3.86 GBdownload

filefunctionary-7b-v2.1.Q5_K_M.gguf4.78 GBdownload

filefunctionary-7b-v2.1.Q5_K_S.gguf4.65 GBdownload

filefunctionary-7b-v2.1.Q6_K.gguf5.53 GBdownload

filefunctionary-7b-v2.1.Q8_0.gguf7.17 GBdownload

mradermacher/functionary-7b-v2.1-GGUF · main · files are served by the source, never re-hosted here