CoolFace
Modelpublic

bartowski/Dolphin3.0-Llama3.1-8B-GGUF

sourceHugging Facellama3.1updated 2y agoView on Hugging Face
29likes19kdownloads
root
file.gitattributes3 KBdownload
fileDolphin3.0-Llama3.1-8B-f16.gguf14.97 GBdownload
fileDolphin3.0-Llama3.1-8B-f32.gguf29.92 GBdownload
fileDolphin3.0-Llama3.1-8B-IQ2_M.gguf2.75 GBdownload
fileDolphin3.0-Llama3.1-8B-IQ3_M.gguf3.52 GBdownload
fileDolphin3.0-Llama3.1-8B-IQ3_XS.gguf3.28 GBdownload
fileDolphin3.0-Llama3.1-8B-IQ4_NL.gguf4.36 GBdownload
fileDolphin3.0-Llama3.1-8B-IQ4_XS.gguf4.14 GBdownload
fileDolphin3.0-Llama3.1-8B-Q2_K_L.gguf3.44 GBdownload
fileDolphin3.0-Llama3.1-8B-Q2_K.gguf2.96 GBdownload
fileDolphin3.0-Llama3.1-8B-Q3_K_L.gguf4.03 GBdownload
fileDolphin3.0-Llama3.1-8B-Q3_K_M.gguf3.74 GBdownload
fileDolphin3.0-Llama3.1-8B-Q3_K_S.gguf3.41 GBdownload
fileDolphin3.0-Llama3.1-8B-Q3_K_XL.gguf4.45 GBdownload
fileDolphin3.0-Llama3.1-8B-Q4_0.gguf4.35 GBdownload
fileDolphin3.0-Llama3.1-8B-Q4_1.gguf4.78 GBdownload
fileDolphin3.0-Llama3.1-8B-Q4_K_L.gguf4.95 GBdownload
fileDolphin3.0-Llama3.1-8B-Q4_K_M.gguf4.58 GBdownload
fileDolphin3.0-Llama3.1-8B-Q4_K_S.gguf4.37 GBdownload
fileDolphin3.0-Llama3.1-8B-Q5_K_L.gguf5.64 GBdownload
fileDolphin3.0-Llama3.1-8B-Q5_K_M.gguf5.34 GBdownload
fileDolphin3.0-Llama3.1-8B-Q5_K_S.gguf5.21 GBdownload
fileDolphin3.0-Llama3.1-8B-Q6_K_L.gguf6.38 GBdownload
fileDolphin3.0-Llama3.1-8B-Q6_K.gguf6.14 GBdownload
fileDolphin3.0-Llama3.1-8B-Q8_0.gguf7.95 GBdownload
fileDolphin3.0-Llama3.1-8B.imatrix4.8 MBdownload
fileREADME.md14 KBdownload

bartowski/Dolphin3.0-Llama3.1-8B-GGUF · main · files are served by the source, never re-hosted here