Modelpublic

mradermacher/Apertus-70B-Instruct-2509-heretic-v2-i1-GGUF

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face

0likes1.4kdownloads

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ1_M.gguf15.74 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ1_S.gguf14.46 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ2_M.gguf22.61 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ2_S.gguf20.89 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ2_XS.gguf19.75 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ2_XXS.gguf17.88 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ3_M.gguf29.84 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ3_S.gguf28.74 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ3_XS.gguf27.55 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ3_XXS.gguf25.53 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-IQ4_XS.gguf35.33 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q2_K_S.gguf22.99 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q2_K.gguf25.40 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q3_K_L.gguf36.87 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q3_K_M.gguf33.10 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q3_K_S.gguf28.65 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q4_0.gguf37.46 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q4_1.gguf41.30 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q4_K_M.gguf40.72 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q4_K_S.gguf37.67 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q5_K_M.gguf47.13 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q5_K_S.gguf45.35 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.i1-Q6_K.gguf53.95 GBdownload

fileApertus-70B-Instruct-2509-heretic-v2.imatrix.gguf25.7 MBdownload

mradermacher/Apertus-70B-Instruct-2509-heretic-v2-i1-GGUF · main · files are served by the source, never re-hosted here