CoolFace
Modelpublic

mradermacher/Llama3.1-8B-Sonnet-GGUF

sourceHugging Facemitupdated 2y agoView on Hugging Face
0likes608downloads
fileLlama3.1-8B-Sonnet.f16.gguf14.97 GBdownload
fileLlama3.1-8B-Sonnet.IQ4_XS.gguf4.18 GBdownload
fileLlama3.1-8B-Sonnet.Q2_K.gguf2.96 GBdownload
fileLlama3.1-8B-Sonnet.Q3_K_L.gguf4.03 GBdownload
fileLlama3.1-8B-Sonnet.Q3_K_M.gguf3.74 GBdownload
fileLlama3.1-8B-Sonnet.Q3_K_S.gguf3.41 GBdownload
fileLlama3.1-8B-Sonnet.Q4_K_M.gguf4.58 GBdownload
fileLlama3.1-8B-Sonnet.Q4_K_S.gguf4.37 GBdownload
fileLlama3.1-8B-Sonnet.Q5_K_M.gguf5.34 GBdownload
fileLlama3.1-8B-Sonnet.Q5_K_S.gguf5.21 GBdownload
fileLlama3.1-8B-Sonnet.Q6_K.gguf6.14 GBdownload
fileLlama3.1-8B-Sonnet.Q8_0.gguf7.95 GBdownload

mradermacher/Llama3.1-8B-Sonnet-GGUF · main · files are served by the source, never re-hosted here