Modelpublic

RichardErkhov/01-ai_-_Yi-6B-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes7.6kdownloads

fileYi-6B.IQ3_M.gguf2.62 GBdownload

fileYi-6B.IQ3_S.gguf2.53 GBdownload

fileYi-6B.IQ3_XS.gguf2.41 GBdownload

fileYi-6B.IQ4_NL.gguf3.27 GBdownload

fileYi-6B.IQ4_XS.gguf3.11 GBdownload

fileYi-6B.Q2_K.gguf2.18 GBdownload

fileYi-6B.Q3_K_L.gguf3.01 GBdownload

fileYi-6B.Q3_K_M.gguf2.79 GBdownload

fileYi-6B.Q3_K_S.gguf2.52 GBdownload

fileYi-6B.Q3_K.gguf2.79 GBdownload

fileYi-6B.Q4_0.gguf3.24 GBdownload

fileYi-6B.Q4_1.gguf3.58 GBdownload

fileYi-6B.Q4_K_M.gguf3.42 GBdownload

fileYi-6B.Q4_K_S.gguf3.26 GBdownload

fileYi-6B.Q4_K.gguf3.42 GBdownload

fileYi-6B.Q5_0.gguf3.92 GBdownload

fileYi-6B.Q5_1.gguf4.25 GBdownload

fileYi-6B.Q5_K_M.gguf4.01 GBdownload

fileYi-6B.Q5_K_S.gguf3.92 GBdownload

fileYi-6B.Q5_K.gguf4.01 GBdownload

fileYi-6B.Q6_K.gguf4.63 GBdownload

RichardErkhov/01-ai_-_Yi-6B-gguf · main · files are served by the source, never re-hosted here