Modelpublic

mradermacher/SmolMoE-4x360M-Instruct-GGUF

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face

1likes445downloads

fileSmolMoE-4x360M-Instruct.f16.gguf1.99 GBdownload

fileSmolMoE-4x360M-Instruct.IQ4_XS.gguf595.2 MBdownload

fileSmolMoE-4x360M-Instruct.Q2_K.gguf558.8 MBdownload

fileSmolMoE-4x360M-Instruct.Q3_K_L.gguf643.2 MBdownload

fileSmolMoE-4x360M-Instruct.Q3_K_M.gguf605.7 MBdownload

fileSmolMoE-4x360M-Instruct.Q3_K_S.gguf558.8 MBdownload

fileSmolMoE-4x360M-Instruct.Q4_K_M.gguf723.5 MBdownload

fileSmolMoE-4x360M-Instruct.Q4_K_S.gguf687.8 MBdownload

fileSmolMoE-4x360M-Instruct.Q5_K_M.gguf784.1 MBdownload

fileSmolMoE-4x360M-Instruct.Q5_K_S.gguf762.7 MBdownload

fileSmolMoE-4x360M-Instruct.Q6_K.gguf1013.5 MBdownload

fileSmolMoE-4x360M-Instruct.Q8_0.gguf1.06 GBdownload

mradermacher/SmolMoE-4x360M-Instruct-GGUF · main · files are served by the source, never re-hosted here