CoolFace
Modelpublic

unsloth/Olmo-3-7B-Instruct-GGUF

sourceHugging Faceapache-2.0updated 10mo agoView on Hugging Face
12likes5kdownloads
fileOlmo-3-7B-Instruct-BF16.gguf13.60 GBdownload
fileOlmo-3-7B-Instruct-IQ4_NL.gguf3.93 GBdownload
fileOlmo-3-7B-Instruct-IQ4_XS.gguf3.74 GBdownload
fileOlmo-3-7B-Instruct-Q2_K_L.gguf2.75 GBdownload
fileOlmo-3-7B-Instruct-Q2_K.gguf2.66 GBdownload
fileOlmo-3-7B-Instruct-Q3_K_M.gguf3.40 GBdownload
fileOlmo-3-7B-Instruct-Q3_K_S.gguf3.08 GBdownload
fileOlmo-3-7B-Instruct-Q4_0.gguf3.94 GBdownload
fileOlmo-3-7B-Instruct-Q4_1.gguf4.33 GBdownload
fileOlmo-3-7B-Instruct-Q4_K_M.gguf4.16 GBdownload
fileOlmo-3-7B-Instruct-Q4_K_S.gguf3.96 GBdownload
fileOlmo-3-7B-Instruct-Q5_K_M.gguf4.85 GBdownload
fileOlmo-3-7B-Instruct-Q5_K_S.gguf4.73 GBdownload
fileOlmo-3-7B-Instruct-Q6_K.gguf5.58 GBdownload
fileOlmo-3-7B-Instruct-Q8_0.gguf7.23 GBdownload
fileOlmo-3-7B-Instruct-UD-IQ1_M.gguf1.90 GBdownload
fileOlmo-3-7B-Instruct-UD-IQ1_S.gguf1.81 GBdownload
fileOlmo-3-7B-Instruct-UD-IQ2_M.gguf2.53 GBdownload
fileOlmo-3-7B-Instruct-UD-IQ2_XXS.gguf2.10 GBdownload
fileOlmo-3-7B-Instruct-UD-IQ3_XXS.gguf2.74 GBdownload
fileOlmo-3-7B-Instruct-UD-Q2_K_XL.gguf2.82 GBdownload
fileOlmo-3-7B-Instruct-UD-Q3_K_XL.gguf3.58 GBdownload
fileOlmo-3-7B-Instruct-UD-Q4_K_XL.gguf4.26 GBdownload
fileOlmo-3-7B-Instruct-UD-Q5_K_XL.gguf4.86 GBdownload
fileOlmo-3-7B-Instruct-UD-Q6_K_XL.gguf6.33 GBdownload
fileOlmo-3-7B-Instruct-UD-Q8_K_XL.gguf8.68 GBdownload

unsloth/Olmo-3-7B-Instruct-GGUF · main · files are served by the source, never re-hosted here