Modelpublic

bartowski/Qwen_Qwen3.5-0.8B-GGUF

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

22likes209kdownloads

filemmproj-Qwen_Qwen3.5-0.8B-bf16.gguf197.7 MBdownload

filemmproj-Qwen_Qwen3.5-0.8B-f16.gguf195.5 MBdownload

fileQwen_Qwen3.5-0.8B-bf16.gguf1.45 GBdownload

fileQwen_Qwen3.5-0.8B-imatrix.gguf1.1 MBdownload

fileQwen_Qwen3.5-0.8B-IQ2_M.gguf380.1 MBdownload

fileQwen_Qwen3.5-0.8B-IQ3_M.gguf484.1 MBdownload

fileQwen_Qwen3.5-0.8B-IQ3_XS.gguf474.8 MBdownload

fileQwen_Qwen3.5-0.8B-IQ3_XXS.gguf433.3 MBdownload

fileQwen_Qwen3.5-0.8B-IQ4_NL.gguf512.7 MBdownload

fileQwen_Qwen3.5-0.8B-IQ4_XS.gguf498.8 MBdownload

fileQwen_Qwen3.5-0.8B-Q2_K_L.gguf501.5 MBdownload

fileQwen_Qwen3.5-0.8B-Q2_K.gguf442.7 MBdownload

fileQwen_Qwen3.5-0.8B-Q3_K_L.gguf504.3 MBdownload

fileQwen_Qwen3.5-0.8B-Q3_K_M.gguf494.0 MBdownload

fileQwen_Qwen3.5-0.8B-Q3_K_S.gguf480.3 MBdownload

fileQwen_Qwen3.5-0.8B-Q3_K_XL.gguf563.1 MBdownload

fileQwen_Qwen3.5-0.8B-Q4_0.gguf512.6 MBdownload

fileQwen_Qwen3.5-0.8B-Q4_1.gguf540.0 MBdownload

fileQwen_Qwen3.5-0.8B-Q4_K_L.gguf611.5 MBdownload

fileQwen_Qwen3.5-0.8B-Q4_K_M.gguf552.8 MBdownload

fileQwen_Qwen3.5-0.8B-Q4_K_S.gguf526.9 MBdownload

fileQwen_Qwen3.5-0.8B-Q5_K_L.gguf674.9 MBdownload

fileQwen_Qwen3.5-0.8B-Q5_K_M.gguf616.2 MBdownload

fileQwen_Qwen3.5-0.8B-Q5_K_S.gguf582.3 MBdownload

fileQwen_Qwen3.5-0.8B-Q6_K_L.gguf718.2 MBdownload

fileQwen_Qwen3.5-0.8B-Q6_K.gguf659.4 MBdownload

fileQwen_Qwen3.5-0.8B-Q8_0.gguf796.6 MBdownload

bartowski/Qwen_Qwen3.5-0.8B-GGUF · main · files are served by the source, never re-hosted here