CoolFace
Modelpublic

bartowski/Replete-LLM-V2-Llama-3.1-8b-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
2likes2.9kdownloads
root
file.gitattributes3 KBdownload
fileREADME.md9 KBdownload
fileReplete-LLM-V2-Llama-3.1-8b-f16.gguf14.97 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-IQ2_M.gguf2.75 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-IQ3_M.gguf3.52 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-IQ3_XS.gguf3.28 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-IQ4_XS.gguf4.14 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q2_K_L.gguf3.44 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q2_K.gguf2.96 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q3_K_L.gguf4.03 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q3_K_M.gguf3.74 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q3_K_S.gguf3.41 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q3_K_XL.gguf4.45 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q4_K_L.gguf4.95 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q4_K_M.gguf4.58 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q4_K_S.gguf4.37 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q5_K_L.gguf5.64 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q5_K_M.gguf5.34 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q5_K_S.gguf5.21 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q6_K_L.gguf6.38 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q6_K.gguf6.14 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b-Q8_0.gguf7.95 GBdownload
fileReplete-LLM-V2-Llama-3.1-8b.imatrix4.8 MBdownload

bartowski/Replete-LLM-V2-Llama-3.1-8b-GGUF · main · files are served by the source, never re-hosted here