Modelpublic

Mungert/Qwen2.5-14B-Instruct-1M-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

6likes3.3kdownloads

fileQwen2.5-14B-Instruct-1M-bf16-q4_k.gguf10.27 GBdownload

fileQwen2.5-14B-Instruct-1M-bf16-q6_k.gguf13.00 GBdownload

fileQwen2.5-14B-Instruct-1M-bf16-q8_0.gguf15.98 GBdownload

fileQwen2.5-14B-Instruct-1M-bf16.gguf27.52 GBdownload

fileQwen2.5-14B-Instruct-1M-f16-q4_k.gguf10.27 GBdownload

fileQwen2.5-14B-Instruct-1M-f16-q6_k.gguf13.00 GBdownload

fileQwen2.5-14B-Instruct-1M-f16-q8_0.gguf15.98 GBdownload

fileQwen2.5-14B-Instruct-1M-iq1_m.gguf4.22 GBdownload

fileQwen2.5-14B-Instruct-1M-iq1_s.gguf4.04 GBdownload

fileQwen2.5-14B-Instruct-1M-iq2_m.gguf5.64 GBdownload

fileQwen2.5-14B-Instruct-1M-iq2_s.gguf5.40 GBdownload

fileQwen2.5-14B-Instruct-1M-iq2_xs.gguf4.80 GBdownload

fileQwen2.5-14B-Instruct-1M-iq2_xxs.gguf4.52 GBdownload

fileQwen2.5-14B-Instruct-1M-iq3_m.gguf6.53 GBdownload

fileQwen2.5-14B-Instruct-1M-iq3_s.gguf6.32 GBdownload

fileQwen2.5-14B-Instruct-1M-iq3_xs.gguf6.04 GBdownload

fileQwen2.5-14B-Instruct-1M-iq3_xxs.gguf5.73 GBdownload

fileQwen2.5-14B-Instruct-1M-iq4_nl.gguf7.96 GBdownload

fileQwen2.5-14B-Instruct-1M-iq4_xs.gguf7.56 GBdownload

fileQwen2.5-14B-Instruct-1M-q2_k_s.gguf5.19 GBdownload

fileQwen2.5-14B-Instruct-1M-q3_k_m.gguf6.93 GBdownload

fileQwen2.5-14B-Instruct-1M-q3_k_s.gguf6.29 GBdownload

fileQwen2.5-14B-Instruct-1M-q4_0.gguf7.75 GBdownload

fileQwen2.5-14B-Instruct-1M-q4_1.gguf8.61 GBdownload

fileQwen2.5-14B-Instruct-1M-q4_k_m.gguf8.56 GBdownload

fileQwen2.5-14B-Instruct-1M-q4_k_s.gguf8.17 GBdownload

fileQwen2.5-14B-Instruct-1M-q5_0.gguf9.47 GBdownload

fileQwen2.5-14B-Instruct-1M-q5_1.gguf10.32 GBdownload

fileQwen2.5-14B-Instruct-1M-q5_k_m.gguf9.88 GBdownload

fileQwen2.5-14B-Instruct-1M-q5_k_s.gguf9.66 GBdownload

fileQwen2.5-14B-Instruct-1M-q6_k_m.gguf11.29 GBdownload

fileQwen2.5-14B-Instruct-1M-q8_0.gguf14.62 GBdownload

Mungert/Qwen2.5-14B-Instruct-1M-GGUF · main · files are served by the source, never re-hosted here