Modelpublic

mradermacher/Tencent-Hy-30B-A3B-uncensored-heretic-i1-GGUF

sourceHugging Faceapache-2.0updated 27d agoView on Hugging Face

1likes9.4kdownloads

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ1_M.gguf6.40 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ1_S.gguf5.78 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ2_M.gguf9.24 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ2_S.gguf8.41 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ2_XS.gguf8.28 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ2_XXS.gguf7.44 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ3_M.gguf12.35 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ3_S.gguf12.17 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ3_XS.gguf11.52 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ3_XXS.gguf10.85 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-IQ4_XS.gguf14.99 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q2_K_S.gguf9.58 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q2_K.gguf10.30 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q3_K_L.gguf14.57 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q3_K_M.gguf13.45 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q3_K_S.gguf12.17 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q4_0.gguf15.91 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q4_1.gguf17.59 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q4_K_M.gguf16.98 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q4_K_S.gguf15.97 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q5_K_M.gguf19.91 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q5_K_S.gguf19.32 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.i1-Q6_K.gguf23.01 GBdownload

fileTencent-Hy-30B-A3B-uncensored-heretic.imatrix.gguf114.9 MBdownload

mradermacher/Tencent-Hy-30B-A3B-uncensored-heretic-i1-GGUF · main · files are served by the source, never re-hosted here