Modelpublic

mradermacher/Q2.5-Instruct-1M_Harmony-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

2likes239downloads

fileQ2.5-Instruct-1M_Harmony.f16.gguf14.19 GBdownload

fileQ2.5-Instruct-1M_Harmony.IQ4_XS.gguf3.96 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q2_K.gguf2.81 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q3_K_L.gguf3.81 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q3_K_M.gguf3.55 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q3_K_S.gguf3.25 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q4_K_M.gguf4.36 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q4_K_S.gguf4.15 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q5_K_M.gguf5.07 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q5_K_S.gguf4.95 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q6_K.gguf5.82 GBdownload

fileQ2.5-Instruct-1M_Harmony.Q8_0.gguf7.54 GBdownload

mradermacher/Q2.5-Instruct-1M_Harmony-GGUF · main · files are served by the source, never re-hosted here