CoolFace
Modelpublic

votal-ai/vai-0.6b-gguf

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes428downloads
fileQwen3-0.6B-BF16.gguf1.12 GBdownload
fileQwen3-0.6B-IQ4_NL.gguf363.9 MBdownload
fileQwen3-0.6B-IQ4_XS.gguf350.8 MBdownload
fileQwen3-0.6B-Q2_K_L.gguf282.5 MBdownload
fileQwen3-0.6B-Q2_K.gguf282.5 MBdownload
fileQwen3-0.6B-Q3_K_M.gguf331.0 MBdownload
fileQwen3-0.6B-Q3_K_S.gguf308.1 MBdownload
fileQwen3-0.6B-Q4_0.gguf364.5 MBdownload
fileQwen3-0.6B-Q4_1.gguf390.1 MBdownload
fileQwen3-0.6B-Q4_K_M.gguf378.3 MBdownload
fileQwen3-0.6B-Q4_K_S.gguf365.5 MBdownload
fileQwen3-0.6B-Q5_K_M.gguf423.8 MBdownload
fileQwen3-0.6B-Q5_K_S.gguf416.4 MBdownload
fileQwen3-0.6B-Q6_K.gguf472.2 MBdownload
fileQwen3-0.6B-Q8_0.gguf609.8 MBdownload
fileQwen3-0.6B-UD-IQ1_M.gguf210.5 MBdownload
fileQwen3-0.6B-UD-IQ1_S.gguf204.7 MBdownload
fileQwen3-0.6B-UD-IQ2_M.gguf256.3 MBdownload
fileQwen3-0.6B-UD-IQ2_XXS.gguf223.2 MBdownload
fileQwen3-0.6B-UD-IQ3_XXS.gguf269.0 MBdownload
fileQwen3-0.6B-UD-Q2_K_XL.gguf287.7 MBdownload
fileQwen3-0.6B-UD-Q3_K_XL.gguf340.1 MBdownload
fileQwen3-0.6B-UD-Q4_K_XL.gguf386.6 MBdownload
fileQwen3-0.6B-UD-Q5_K_XL.gguf425.7 MBdownload
fileQwen3-0.6B-UD-Q6_K_XL.gguf549.8 MBdownload
fileQwen3-0.6B-UD-Q8_K_XL.gguf805.2 MBdownload

votal-ai/vai-0.6b-gguf · main · files are served by the source, never re-hosted here