CoolFace
Modelpublic

bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
26likes4.1kdownloads
root
dirReplete-LLM-V2.5-Qwen-32b-f16/
file.gitattributes3 KBdownload
fileREADME.md10 KBdownload
fileReplete-LLM-V2.5-Qwen-32b-IQ2_M.gguf10.49 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-IQ2_S.gguf9.67 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-IQ2_XS.gguf9.27 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-IQ3_M.gguf13.79 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-IQ3_XS.gguf12.76 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-IQ4_NL.gguf17.40 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-IQ4_XS.gguf16.48 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q2_K_L.gguf12.18 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q2_K.gguf11.47 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q3_K_L.gguf16.06 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q3_K_M.gguf14.84 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q3_K_S.gguf13.40 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q3_K_XL.gguf16.70 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q4_0.gguf17.43 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q4_K_L.gguf19.03 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q4_K_M.gguf18.49 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q4_K_S.gguf17.49 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q5_K_L.gguf22.11 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q5_K_M.gguf21.66 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q5_K_S.gguf21.08 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q6_K_L.gguf25.39 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q6_K.gguf25.04 GBdownload
fileReplete-LLM-V2.5-Qwen-32b-Q8_0.gguf32.43 GBdownload
fileReplete-LLM-V2.5-Qwen-32b.imatrix14.3 MBdownload

bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF · main · files are served by the source, never re-hosted here