Modelpublic

mradermacher/SmolLM2-360M-Instruct-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

1likes780downloads

fileSmolLM2-360M-Instruct.f16.gguf691.9 MBdownload

fileSmolLM2-360M-Instruct.IQ4_XS.gguf217.6 MBdownload

fileSmolLM2-360M-Instruct.Q2_K.gguf208.5 MBdownload

fileSmolLM2-360M-Instruct.Q3_K_L.gguf234.9 MBdownload

fileSmolLM2-360M-Instruct.Q3_K_M.gguf223.8 MBdownload

fileSmolLM2-360M-Instruct.Q3_K_S.gguf208.5 MBdownload

fileSmolLM2-360M-Instruct.Q4_0_4_4.gguf218.5 MBdownload

fileSmolLM2-360M-Instruct.Q4_K_M.gguf258.1 MBdownload

fileSmolLM2-360M-Instruct.Q4_K_S.gguf247.9 MBdownload

fileSmolLM2-360M-Instruct.Q5_K_M.gguf276.5 MBdownload

fileSmolLM2-360M-Instruct.Q5_K_S.gguf270.1 MBdownload

fileSmolLM2-360M-Instruct.Q6_K.gguf350.3 MBdownload

fileSmolLM2-360M-Instruct.Q8_0.gguf368.5 MBdownload

mradermacher/SmolLM2-360M-Instruct-GGUF · main · files are served by the source, never re-hosted here