Modelpublic

Mungert/Magistral-Small-2506-abliterated-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

1likes1.7kdownloads

fileMagistral-Small-2506-abliterated-bf16_q8_0.gguf31.28 GBdownload

fileMagistral-Small-2506-abliterated-bf16.gguf43.92 GBdownload

fileMagistral-Small-2506-abliterated-f16_q8_0.gguf31.28 GBdownload

fileMagistral-Small-2506-abliterated-iq1_m.gguf6.56 GBdownload

fileMagistral-Small-2506-abliterated-iq1_s.gguf6.07 GBdownload

fileMagistral-Small-2506-abliterated-iq2_m.gguf8.09 GBdownload

fileMagistral-Small-2506-abliterated-iq2_s.gguf7.68 GBdownload

fileMagistral-Small-2506-abliterated-iq2_xs.gguf7.44 GBdownload

fileMagistral-Small-2506-abliterated-iq2_xxs.gguf6.85 GBdownload

fileMagistral-Small-2506-abliterated-iq3_m.gguf9.89 GBdownload

fileMagistral-Small-2506-abliterated-iq3_s.gguf9.78 GBdownload

fileMagistral-Small-2506-abliterated-iq3_xs.gguf9.30 GBdownload

fileMagistral-Small-2506-abliterated-iq3_xxs.gguf8.86 GBdownload

fileMagistral-Small-2506-abliterated-iq4_nl.gguf12.54 GBdownload

fileMagistral-Small-2506-abliterated-iq4_xs.gguf11.88 GBdownload

fileMagistral-Small-2506-abliterated-q2_k_m.gguf8.51 GBdownload

fileMagistral-Small-2506-abliterated-q2_k_s.gguf7.81 GBdownload

fileMagistral-Small-2506-abliterated-q3_k_m.gguf10.84 GBdownload

fileMagistral-Small-2506-abliterated-q3_k_s.gguf9.91 GBdownload

fileMagistral-Small-2506-abliterated-q4_0.gguf12.36 GBdownload

fileMagistral-Small-2506-abliterated-q4_1.gguf13.73 GBdownload

fileMagistral-Small-2506-abliterated-q4_k_m.gguf13.36 GBdownload

fileMagistral-Small-2506-abliterated-q4_k_s.gguf12.88 GBdownload

fileMagistral-Small-2506-abliterated-q5_0.gguf15.10 GBdownload

fileMagistral-Small-2506-abliterated-q5_1.gguf16.47 GBdownload

fileMagistral-Small-2506-abliterated-q5_k_m.gguf15.72 GBdownload

fileMagistral-Small-2506-abliterated-q5_k_s.gguf15.46 GBdownload

fileMagistral-Small-2506-abliterated-q6_k_m.gguf18.02 GBdownload

fileMagistral-Small-2506-abliterated-q8_0.gguf23.33 GBdownload

fileMagistral-Small-2506-abliterated-tq1_0.gguf5.24 GBdownload

fileMagistral-Small-2506-abliterated-tq2_0.gguf6.21 GBdownload

Mungert/Magistral-Small-2506-abliterated-GGUF · main · files are served by the source, never re-hosted here