Modelpublic

mradermacher/internlm2_5-1_8b-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

0likes2.1kdownloads

fileinternlm2_5-1_8b.f16.gguf3.52 GBdownload

fileinternlm2_5-1_8b.IQ3_M.gguf872.6 MBdownload

fileinternlm2_5-1_8b.IQ3_S.gguf847.1 MBdownload

fileinternlm2_5-1_8b.IQ3_XS.gguf813.4 MBdownload

fileinternlm2_5-1_8b.IQ4_XS.gguf1019.2 MBdownload

fileinternlm2_5-1_8b.Q2_K.gguf736.1 MBdownload

fileinternlm2_5-1_8b.Q3_K_L.gguf983.2 MBdownload

fileinternlm2_5-1_8b.Q3_K_M.gguf919.7 MBdownload

fileinternlm2_5-1_8b.Q3_K_S.gguf847.1 MBdownload

fileinternlm2_5-1_8b.Q4_K_M.gguf1.09 GBdownload

fileinternlm2_5-1_8b.Q4_K_S.gguf1.04 GBdownload

fileinternlm2_5-1_8b.Q5_K_M.gguf1.26 GBdownload

fileinternlm2_5-1_8b.Q5_K_S.gguf1.24 GBdownload

fileinternlm2_5-1_8b.Q6_K.gguf1.45 GBdownload

fileinternlm2_5-1_8b.Q8_0.gguf1.87 GBdownload

mradermacher/internlm2_5-1_8b-GGUF · main · files are served by the source, never re-hosted here