CoolFace
Modelpublic

Mungert/Llama-3.3-8B-Instruct-GGUF

sourceHugging Facellama3.3updated 9mo agoView on Hugging Face
2likes3kdownloads
fileLlama-3.3-8B-Instruct-bf16_q8_0.gguf11.10 GBdownload
fileLlama-3.3-8B-Instruct-bf16.gguf14.97 GBdownload
fileLlama-3.3-8B-Instruct-f16_q8_0.gguf11.10 GBdownload
fileLlama-3.3-8B-Instruct-imatrix.gguf4.8 MBdownload
fileLlama-3.3-8B-Instruct-iq2_m.gguf2.97 GBdownload
fileLlama-3.3-8B-Instruct-iq2_s.gguf2.85 GBdownload
fileLlama-3.3-8B-Instruct-iq2_xs.gguf2.77 GBdownload
fileLlama-3.3-8B-Instruct-iq2_xxs.gguf2.58 GBdownload
fileLlama-3.3-8B-Instruct-iq3_m.gguf3.82 GBdownload
fileLlama-3.3-8B-Instruct-iq3_xs.gguf3.50 GBdownload
fileLlama-3.3-8B-Instruct-iq3_xxs.gguf3.42 GBdownload
fileLlama-3.3-8B-Instruct-iq4_nl.gguf4.23 GBdownload
fileLlama-3.3-8B-Instruct-iq4_xs.gguf4.28 GBdownload
fileLlama-3.3-8B-Instruct-q2_k_m.gguf3.04 GBdownload
fileLlama-3.3-8B-Instruct-q2_k_s.gguf2.92 GBdownload
fileLlama-3.3-8B-Instruct-q3_k_m.gguf3.91 GBdownload
fileLlama-3.3-8B-Instruct-q3_k_s.gguf3.78 GBdownload
fileLlama-3.3-8B-Instruct-q4_0.gguf4.70 GBdownload
fileLlama-3.3-8B-Instruct-q4_1.gguf4.74 GBdownload
fileLlama-3.3-8B-Instruct-q4_k_m.gguf4.90 GBdownload
fileLlama-3.3-8B-Instruct-q4_k_s.gguf4.54 GBdownload
fileLlama-3.3-8B-Instruct-q5_0.gguf5.52 GBdownload
fileLlama-3.3-8B-Instruct-q5_1.gguf5.92 GBdownload
fileLlama-3.3-8B-Instruct-q5_k_m.gguf5.66 GBdownload
fileLlama-3.3-8B-Instruct-q6_k_m.gguf6.38 GBdownload
fileLlama-3.3-8B-Instruct-q8_0.gguf7.95 GBdownload

Mungert/Llama-3.3-8B-Instruct-GGUF · main · files are served by the source, never re-hosted here