Modelpublic

mradermacher/TypeII-A-12B-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

1likes1.3kdownloads

fileTypeII-A-12B.IQ3_M.gguf5.33 GBdownload

fileTypeII-A-12B.IQ3_S.gguf5.18 GBdownload

fileTypeII-A-12B.IQ3_XS.gguf4.94 GBdownload

fileTypeII-A-12B.IQ4_XS.gguf6.33 GBdownload

fileTypeII-A-12B.Q2_K.gguf4.46 GBdownload

fileTypeII-A-12B.Q3_K_L.gguf6.11 GBdownload

fileTypeII-A-12B.Q3_K_M.gguf5.67 GBdownload

fileTypeII-A-12B.Q3_K_S.gguf5.15 GBdownload

fileTypeII-A-12B.Q4_K_M.gguf6.96 GBdownload

fileTypeII-A-12B.Q4_K_S.gguf6.63 GBdownload

fileTypeII-A-12B.Q5_K_M.gguf8.13 GBdownload

fileTypeII-A-12B.Q5_K_S.gguf7.93 GBdownload

fileTypeII-A-12B.Q6_K.gguf9.37 GBdownload

fileTypeII-A-12B.Q8_0.gguf12.13 GBdownload

mradermacher/TypeII-A-12B-GGUF · main · files are served by the source, never re-hosted here