Modelpublic

mradermacher/Faro-Yi-34B-i1-GGUF

sourceHugging Facemitupdated 2y agoView on Hugging Face

0likes4.4kdownloads

fileFaro-Yi-34B.i1-IQ1_M.gguf7.62 GBdownload

fileFaro-Yi-34B.i1-IQ1_S.gguf6.98 GBdownload

fileFaro-Yi-34B.i1-IQ2_M.gguf10.98 GBdownload

fileFaro-Yi-34B.i1-IQ2_S.gguf10.14 GBdownload

fileFaro-Yi-34B.i1-IQ2_XS.gguf9.60 GBdownload

fileFaro-Yi-34B.i1-IQ2_XXS.gguf8.67 GBdownload

fileFaro-Yi-34B.i1-IQ3_M.gguf14.50 GBdownload

fileFaro-Yi-34B.i1-IQ3_S.gguf13.99 GBdownload

fileFaro-Yi-34B.i1-IQ3_XS.gguf13.26 GBdownload

fileFaro-Yi-34B.i1-IQ3_XXS.gguf12.42 GBdownload

fileFaro-Yi-34B.i1-IQ4_XS.gguf17.21 GBdownload

fileFaro-Yi-34B.i1-Q2_K.gguf11.94 GBdownload

fileFaro-Yi-34B.i1-Q3_K_L.gguf16.89 GBdownload

fileFaro-Yi-34B.i1-Q3_K_M.gguf15.51 GBdownload

fileFaro-Yi-34B.i1-Q3_K_S.gguf13.93 GBdownload

fileFaro-Yi-34B.i1-Q4_0.gguf18.19 GBdownload

fileFaro-Yi-34B.i1-Q4_K_M.gguf19.24 GBdownload

fileFaro-Yi-34B.i1-Q4_K_S.gguf18.25 GBdownload

fileFaro-Yi-34B.i1-Q5_K_M.gguf22.65 GBdownload

fileFaro-Yi-34B.i1-Q5_K_S.gguf22.08 GBdownload

fileFaro-Yi-34B.i1-Q6_K.gguf26.28 GBdownload

mradermacher/Faro-Yi-34B-i1-GGUF · main · files are served by the source, never re-hosted here