CoolFace
Modelpublic

bartowski/Rombos-LLM-V2.6-Qwen-14b-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
13likes2.2kdownloads
root
file.gitattributes3 KBdownload
fileREADME.md10 KBdownload
fileRombos-LLM-V2.6-Qwen-14b-f16.gguf27.52 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-IQ2_M.gguf4.99 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-IQ2_S.gguf4.66 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-IQ3_M.gguf6.44 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-IQ3_XS.gguf5.94 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-IQ4_XS.gguf7.56 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q2_K_L.gguf6.08 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q2_K.gguf5.37 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q3_K_L.gguf7.38 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q3_K_M.gguf6.84 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q3_K_S.gguf6.20 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q3_K_XL.gguf8.01 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q4_0_4_4.gguf7.93 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q4_0_4_8.gguf7.93 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q4_0_8_8.gguf7.93 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q4_0.gguf7.96 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q4_K_L.gguf8.91 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q4_K_M.gguf8.37 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q4_K_S.gguf7.98 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q5_K_L.gguf10.23 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q5_K_M.gguf9.79 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q5_K_S.gguf9.56 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q6_K_L.gguf11.64 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q6_K.gguf11.29 GBdownload
fileRombos-LLM-V2.6-Qwen-14b-Q8_0.gguf14.62 GBdownload
fileRombos-LLM-V2.6-Qwen-14b.imatrix8.2 MBdownload

bartowski/Rombos-LLM-V2.6-Qwen-14b-GGUF · main · files are served by the source, never re-hosted here