Modelpublic

mradermacher/ALIA-40b-i1-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

5likes1.2kdownloads

fileALIA-40b.i1-IQ1_M.gguf9.74 GBdownload

fileALIA-40b.i1-IQ1_S.gguf9.06 GBdownload

fileALIA-40b.i1-IQ2_M.gguf13.54 GBdownload

fileALIA-40b.i1-IQ2_S.gguf12.63 GBdownload

fileALIA-40b.i1-IQ2_XS.gguf11.89 GBdownload

fileALIA-40b.i1-IQ2_XXS.gguf10.89 GBdownload

fileALIA-40b.i1-IQ3_M.gguf17.55 GBdownload

fileALIA-40b.i1-IQ3_S.gguf17.00 GBdownload

fileALIA-40b.i1-IQ3_XS.gguf16.21 GBdownload

fileALIA-40b.i1-IQ3_XXS.gguf15.11 GBdownload

fileALIA-40b.i1-IQ4_XS.gguf20.64 GBdownload

fileALIA-40b.i1-Q2_K_S.gguf13.68 GBdownload

fileALIA-40b.i1-Q2_K.gguf14.63 GBdownload

fileALIA-40b.i1-Q3_K_L.gguf20.14 GBdownload

fileALIA-40b.i1-Q3_K_M.gguf18.67 GBdownload

fileALIA-40b.i1-Q3_K_S.gguf16.95 GBdownload

fileALIA-40b.i1-Q4_0.gguf21.76 GBdownload

fileALIA-40b.i1-Q4_1.gguf23.93 GBdownload

fileALIA-40b.i1-Q4_K_M.gguf22.90 GBdownload

fileALIA-40b.i1-Q4_K_S.gguf21.84 GBdownload

fileALIA-40b.i1-Q5_K_M.gguf26.78 GBdownload

fileALIA-40b.i1-Q5_K_S.gguf26.16 GBdownload

fileALIA-40b.i1-Q6_K.gguf30.90 GBdownload

mradermacher/ALIA-40b-i1-GGUF · main · files are served by the source, never re-hosted here