CoolFace
Modelpublic

mradermacher/Mermaid-Llama-3-4B-Pruned-GGUF

sourceHugging Facecc-by-4.0updated 2y agoView on Hugging Face
0likes181downloads
root
file.gitattributes3 KBdownload
fileMermaid-Llama-3-4B-Pruned.f16.gguf8.47 GBdownload
fileMermaid-Llama-3-4B-Pruned.IQ3_M.gguf2.07 GBdownload
fileMermaid-Llama-3-4B-Pruned.IQ3_S.gguf2.02 GBdownload
fileMermaid-Llama-3-4B-Pruned.IQ3_XS.gguf1.95 GBdownload
fileMermaid-Llama-3-4B-Pruned.IQ4_XS.gguf2.42 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q2_K.gguf1.77 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q3_K_L.gguf2.32 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q3_K_M.gguf2.18 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q3_K_S.gguf2.02 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q4_K_M.gguf2.63 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q4_K_S.gguf2.53 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q5_K_M.gguf3.04 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q5_K_S.gguf2.98 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q6_K.gguf3.48 GBdownload
fileMermaid-Llama-3-4B-Pruned.Q8_0.gguf4.50 GBdownload
fileREADME.md4 KBdownload

mradermacher/Mermaid-Llama-3-4B-Pruned-GGUF · main · files are served by the source, never re-hosted here