gguf-org/quant-type
1435
i-quant-iq1_m.ggufdownload
i-quant-iq1_s.ggufdownload
i-quant-iq2_m.ggufdownload
i-quant-iq2_s.ggufdownload
i-quant-iq2_xs.ggufdownload
i-quant-iq2_xxs.ggufdownload
i-quant-iq3_m.ggufdownload
i-quant-iq3_s.ggufdownload
i-quant-iq3_xxs.ggufdownload
i-quant-iq4_nl.ggufdownload
i-quant-iq4_xs.ggufdownload
k-quant-q2_k_s.ggufdownload
k-quant-q2_k.ggufdownload
k-quant-q3_k_m.ggufdownload
k-quant-q4_k_m.ggufdownload
k-quant-q5_k_m.ggufdownload
k-quant-q6_k.ggufdownload
s-quant-q4_0.ggufdownload
s-quant-q4_1.ggufdownload
s-quant-q5_0.ggufdownload
s-quant-q5_1.ggufdownload
s-quant-q8_0.ggufdownload
t-quant-tq1_0.ggufdownload
t-quant-tq2_0.ggufdownload