CoolFace
Modelpublic

mradermacher/Llama-3.1-Minitron-4B-Depth-Base-GGUF

sourceHugging Faceotherupdated 2y agoView on Hugging Face
0likes301downloads
root
file.gitattributes3 KBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.f16.gguf8.46 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.IQ3_M.gguf2.07 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.IQ3_S.gguf2.02 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.IQ3_XS.gguf1.95 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.IQ4_XS.gguf2.42 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q2_K.gguf1.76 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q3_K_L.gguf2.32 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q3_K_M.gguf2.18 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q3_K_S.gguf2.02 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q4_K_M.gguf2.63 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q4_K_S.gguf2.53 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q5_K_M.gguf3.04 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q5_K_S.gguf2.98 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q6_K.gguf3.48 GBdownload
fileLlama-3.1-Minitron-4B-Depth-Base.Q8_0.gguf4.50 GBdownload
fileREADME.md4 KBdownload

mradermacher/Llama-3.1-Minitron-4B-Depth-Base-GGUF · main · files are served by the source, never re-hosted here