CoolFace
Modelpublic

unsloth/Llama-3.3-70B-Instruct-GGUF

sourceHugging Facellama3.3updated 1y agoView on Hugging Face
128likes34kdownloads
fileLlama-3.3-70B-Instruct-IQ4_NL.gguf37.30 GBdownload
fileLlama-3.3-70B-Instruct-IQ4_XS.gguf35.33 GBdownload
fileLlama-3.3-70B-Instruct-Q2_K_L.gguf24.79 GBdownload
fileLlama-3.3-70B-Instruct-Q2_K.gguf24.56 GBdownload
fileLlama-3.3-70B-Instruct-Q3_K_M.gguf31.91 GBdownload
fileLlama-3.3-70B-Instruct-Q3_K_S.gguf28.79 GBdownload
fileLlama-3.3-70B-Instruct-Q4_0.gguf37.36 GBdownload
fileLlama-3.3-70B-Instruct-Q4_1.gguf41.27 GBdownload
fileLlama-3.3-70B-Instruct-Q4_K_M.gguf39.60 GBdownload
fileLlama-3.3-70B-Instruct-Q4_K_S.gguf37.58 GBdownload
fileLlama-3.3-70B-Instruct-Q5_K_M.gguf46.52 GBdownload
fileLlama-3.3-70B-Instruct-Q5_K_S.gguf45.32 GBdownload
fileLlama-3.3-70B-Instruct-UD-IQ1_M.gguf15.97 GBdownload
fileLlama-3.3-70B-Instruct-UD-IQ1_S.gguf14.77 GBdownload
fileLlama-3.3-70B-Instruct-UD-IQ2_M.gguf22.63 GBdownload
fileLlama-3.3-70B-Instruct-UD-IQ2_XXS.gguf18.10 GBdownload
fileLlama-3.3-70B-Instruct-UD-IQ3_XXS.gguf25.76 GBdownload
fileLlama-3.3-70B-Instruct-UD-Q2_K_XL.gguf25.11 GBdownload
fileLlama-3.3-70B-Instruct-UD-Q3_K_XL.gguf32.40 GBdownload
fileLlama-3.3-70B-Instruct-UD-Q4_K_XL.gguf39.73 GBdownload
fileLlama-3.3-70B-Instruct-UD-Q5_K_XL.gguf46.44 GBdownload

unsloth/Llama-3.3-70B-Instruct-GGUF · main · files are served by the source, never re-hosted here