CoolFace
Modelpublic

Mungert/Llama-Guard-3-8B-GGUF

sourceHugging Facellama3.1updated 1y agoView on Hugging Face
2likes1.4kdownloads
root
file.gitattributes4 KBdownload
fileLlama-Guard-3-8B-bf16-q4_k.gguf5.86 GBdownload
fileLlama-Guard-3-8B-bf16-q6_k.gguf7.30 GBdownload
fileLlama-Guard-3-8B-bf16-q8_0.gguf8.87 GBdownload
fileLlama-Guard-3-8B-bf16.gguf14.97 GBdownload
fileLlama-Guard-3-8B-f16-q4_k.gguf5.86 GBdownload
fileLlama-Guard-3-8B-f16-q6_k.gguf7.30 GBdownload
fileLlama-Guard-3-8B-f16-q8_0.gguf8.87 GBdownload
fileLlama-Guard-3-8B-iq1_m.gguf2.01 GBdownload
fileLlama-Guard-3-8B-iq1_s.gguf1.88 GBdownload
fileLlama-Guard-3-8B-iq2_m.gguf2.75 GBdownload
fileLlama-Guard-3-8B-iq2_s.gguf2.57 GBdownload
fileLlama-Guard-3-8B-iq2_xs.gguf2.43 GBdownload
fileLlama-Guard-3-8B-iq2_xxs.gguf2.23 GBdownload
fileLlama-Guard-3-8B-iq3_m.gguf3.52 GBdownload
fileLlama-Guard-3-8B-iq3_s.gguf3.43 GBdownload
fileLlama-Guard-3-8B-iq3_xs.gguf3.28 GBdownload
fileLlama-Guard-3-8B-iq3_xxs.gguf3.05 GBdownload
fileLlama-Guard-3-8B-iq4_nl.gguf4.36 GBdownload
fileLlama-Guard-3-8B-iq4_xs.gguf4.14 GBdownload
fileLlama-Guard-3-8B-q2_k_s.gguf2.78 GBdownload
fileLlama-Guard-3-8B-q3_k_m.gguf3.74 GBdownload
fileLlama-Guard-3-8B-q3_k_s.gguf3.41 GBdownload
fileLlama-Guard-3-8B-q4_0.gguf4.21 GBdownload
fileLlama-Guard-3-8B-q4_1.gguf4.68 GBdownload
fileLlama-Guard-3-8B-q4_k_m.gguf4.58 GBdownload
fileLlama-Guard-3-8B-q4_k_s.gguf4.37 GBdownload
fileLlama-Guard-3-8B-q5_0.gguf5.15 GBdownload
fileLlama-Guard-3-8B-q5_1.gguf5.62 GBdownload
fileLlama-Guard-3-8B-q5_k_m.gguf5.34 GBdownload
fileLlama-Guard-3-8B-q5_k_s.gguf5.21 GBdownload
fileLlama-Guard-3-8B-q6_k_m.gguf6.14 GBdownload
fileLlama-Guard-3-8B-q8_0.gguf7.95 GBdownload
fileLlama-Guard-3-8B.imatrix4.8 MBdownload
fileREADME.md40 KBdownload

Mungert/Llama-Guard-3-8B-GGUF · main · files are served by the source, never re-hosted here