CoolFace
Modelpublic

mradermacher/qwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
1likes140downloads
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.f16.gguf14.19 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.IQ4_XS.gguf3.96 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q2_K.gguf2.81 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q3_K_L.gguf3.81 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q3_K_M.gguf3.55 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q3_K_S.gguf3.25 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q4_K_M.gguf4.36 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q4_K_S.gguf4.15 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q5_K_M.gguf5.07 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q5_K_S.gguf4.95 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q6_K.gguf5.82 GBdownload
fileqwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b.Q8_0.gguf7.54 GBdownload

mradermacher/qwen2-5_openthoughts_2-5k_rewrite_r1_distill_llama70b-GGUF · main · files are served by the source, never re-hosted here