CoolFace
Modelpublic

mradermacher/Nous-Hermes-2-Yi-34B-i1-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
2likes4.7kdownloads
root
file.gitattributes3 KBdownload
fileimatrix.dat14.5 MBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ1_M.gguf7.62 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ1_S.gguf7.54 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ2_M.gguf11.55 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ2_S.gguf10.70 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ2_XS.gguf10.16 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ2_XXS.gguf9.23 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ3_M.gguf15.00 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ3_S.gguf14.49 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ3_XS.gguf13.71 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ3_XXS.gguf12.98 GBdownload
fileNous-Hermes-2-Yi-34B.i1-IQ4_XS.gguf17.21 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q2_K.gguf12.45 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q3_K_L.gguf17.40 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q3_K_M.gguf16.02 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q3_K_S.gguf14.44 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q4_0.gguf18.19 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q4_K_M.gguf19.74 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q4_K_S.gguf18.76 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q5_K_M.gguf23.16 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q5_K_S.gguf22.58 GBdownload
fileNous-Hermes-2-Yi-34B.i1-Q6_K.gguf26.78 GBdownload
fileREADME.md5 KBdownload

mradermacher/Nous-Hermes-2-Yi-34B-i1-GGUF · main · files are served by the source, never re-hosted here