Modelpublic

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

11likes149kdownloads

fileQwen2.5-7B-Instruct.fp16.gguf14.19 GBdownload

fileQwen2.5-7B-Instruct.IQ1_M.gguf1.90 GBdownload

fileQwen2.5-7B-Instruct.IQ1_S.gguf1.77 GBdownload

fileQwen2.5-7B-Instruct.IQ2_XS.gguf2.30 GBdownload

fileQwen2.5-7B-Instruct.IQ3_XS.gguf3.12 GBdownload

fileQwen2.5-7B-Instruct.IQ4_XS.gguf3.93 GBdownload

fileQwen2.5-7B-Instruct.Q2_K.gguf2.81 GBdownload

fileQwen2.5-7B-Instruct.Q3_K_L.gguf3.81 GBdownload

fileQwen2.5-7B-Instruct.Q3_K_M.gguf3.55 GBdownload

fileQwen2.5-7B-Instruct.Q3_K_S.gguf3.25 GBdownload

fileQwen2.5-7B-Instruct.Q4_K_M.gguf4.36 GBdownload

fileQwen2.5-7B-Instruct.Q4_K_S.gguf4.15 GBdownload

fileQwen2.5-7B-Instruct.Q5_K_M.gguf5.07 GBdownload

fileQwen2.5-7B-Instruct.Q5_K_S.gguf4.95 GBdownload

fileQwen2.5-7B-Instruct.Q6_K.gguf5.82 GBdownload

fileQwen2.5-7B-Instruct.Q8_0.gguf7.54 GBdownload

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF · main · files are served by the source, never re-hosted here