Modelpublic

mradermacher/OLMo-7B-0424-hf-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

0likes1.9kdownloads

fileOLMo-7B-0424-hf.f16.gguf12.83 GBdownload

fileOLMo-7B-0424-hf.IQ3_M.gguf2.99 GBdownload

fileOLMo-7B-0424-hf.IQ3_S.gguf2.83 GBdownload

fileOLMo-7B-0424-hf.IQ3_XS.gguf2.69 GBdownload

fileOLMo-7B-0424-hf.IQ4_XS.gguf3.49 GBdownload

fileOLMo-7B-0424-hf.Q2_K.gguf2.44 GBdownload

fileOLMo-7B-0424-hf.Q3_K_L.gguf3.44 GBdownload

fileOLMo-7B-0424-hf.Q3_K_M.gguf3.16 GBdownload

fileOLMo-7B-0424-hf.Q3_K_S.gguf2.83 GBdownload

fileOLMo-7B-0424-hf.Q4_K_M.gguf3.90 GBdownload

fileOLMo-7B-0424-hf.Q4_K_S.gguf3.69 GBdownload

fileOLMo-7B-0424-hf.Q5_K_M.gguf4.56 GBdownload

fileOLMo-7B-0424-hf.Q5_K_S.gguf4.44 GBdownload

fileOLMo-7B-0424-hf.Q6_K.gguf5.26 GBdownload

fileOLMo-7B-0424-hf.Q8_0.gguf6.82 GBdownload

mradermacher/OLMo-7B-0424-hf-GGUF · main · files are served by the source, never re-hosted here