Modelpublic

mradermacher/TANIT-V0.5-Medium-9B-IT-GGUF

sourceHugging Faceapache-2.0updated 11mo agoView on Hugging Face

1likes525downloads

fileTANIT-V0.5-Medium-9B-IT.f16.gguf17.22 GBdownload

fileTANIT-V0.5-Medium-9B-IT.IQ4_XS.gguf4.86 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q2_K.gguf3.54 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q3_K_L.gguf4.78 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q3_K_M.gguf4.43 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q3_K_S.gguf4.04 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q4_K_M.gguf5.37 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q4_K_S.gguf5.10 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q5_K_M.gguf6.19 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q5_K_S.gguf6.04 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q6_K.gguf7.07 GBdownload

fileTANIT-V0.5-Medium-9B-IT.Q8_0.gguf9.15 GBdownload

mradermacher/TANIT-V0.5-Medium-9B-IT-GGUF · main · files are served by the source, never re-hosted here