Modelpublic

mradermacher/Qwen2.5-VL-7B-Instruct-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face

5likes35kdownloads

fileQwen2.5-VL-7B-Instruct.f16.gguf14.19 GBdownload

fileQwen2.5-VL-7B-Instruct.IQ4_XS.gguf3.96 GBdownload

fileQwen2.5-VL-7B-Instruct.mmproj-f16.gguf1.26 GBdownload

fileQwen2.5-VL-7B-Instruct.mmproj-Q8_0.gguf813.6 MBdownload

fileQwen2.5-VL-7B-Instruct.Q2_K.gguf2.81 GBdownload

fileQwen2.5-VL-7B-Instruct.Q3_K_L.gguf3.81 GBdownload

fileQwen2.5-VL-7B-Instruct.Q3_K_M.gguf3.55 GBdownload

fileQwen2.5-VL-7B-Instruct.Q3_K_S.gguf3.25 GBdownload

fileQwen2.5-VL-7B-Instruct.Q4_K_M.gguf4.36 GBdownload

fileQwen2.5-VL-7B-Instruct.Q4_K_S.gguf4.15 GBdownload

fileQwen2.5-VL-7B-Instruct.Q5_K_M.gguf5.07 GBdownload

fileQwen2.5-VL-7B-Instruct.Q5_K_S.gguf4.95 GBdownload

fileQwen2.5-VL-7B-Instruct.Q6_K.gguf5.82 GBdownload

fileQwen2.5-VL-7B-Instruct.Q8_0.gguf7.54 GBdownload

mradermacher/Qwen2.5-VL-7B-Instruct-GGUF · main · files are served by the source, never re-hosted here