CoolFace
Modelpublic

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes3.6kdownloads
fileQwen2.5-0.5B-Instruct.BF16.gguf948.1 MBdownload
fileQwen2.5-0.5B-Instruct.FP16.gguf948.1 MBdownload
fileQwen2.5-0.5B-Instruct.IQ1_M.gguf303.2 MBdownload
fileQwen2.5-0.5B-Instruct.IQ1_S.gguf301.2 MBdownload
fileQwen2.5-0.5B-Instruct.IQ2_M.gguf313.4 MBdownload
fileQwen2.5-0.5B-Instruct.IQ2_S.gguf310.6 MBdownload
fileQwen2.5-0.5B-Instruct.IQ2_XS.gguf309.4 MBdownload
fileQwen2.5-0.5B-Instruct.IQ2_XXS.gguf306.7 MBdownload
fileQwen2.5-0.5B-Instruct.IQ3_M.gguf326.9 MBdownload
fileQwen2.5-0.5B-Instruct.IQ3_S.gguf322.9 MBdownload
fileQwen2.5-0.5B-Instruct.IQ3_XS.gguf322.9 MBdownload
fileQwen2.5-0.5B-Instruct.IQ3_XXS.gguf318.2 MBdownload
fileQwen2.5-0.5B-Instruct.IQ4_NL.gguf336.3 MBdownload
fileQwen2.5-0.5B-Instruct.IQ4_XS.gguf333.2 MBdownload
fileQwen2.5-0.5B-Instruct.Q2_K_S.gguf315.7 MBdownload
fileQwen2.5-0.5B-Instruct.Q2_K.gguf322.9 MBdownload
fileQwen2.5-0.5B-Instruct.Q3_K_L.gguf352.2 MBdownload
fileQwen2.5-0.5B-Instruct.Q3_K_S.gguf322.6 MBdownload
fileQwen2.5-0.5B-Instruct.Q3_K.gguf339.0 MBdownload
fileQwen2.5-0.5B-Instruct.Q4_K_S.gguf367.6 MBdownload
fileQwen2.5-0.5B-Instruct.Q4_K.gguf379.4 MBdownload
fileQwen2.5-0.5B-Instruct.Q5_K_S.gguf393.6 MBdownload
fileQwen2.5-0.5B-Instruct.Q5_K.gguf400.6 MBdownload
fileQwen2.5-0.5B-Instruct.Q6_K.gguf482.3 MBdownload
fileQwen2.5-0.5B-Instruct.Q8_0.gguf506.5 MBdownload

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF · main · files are served by the source, never re-hosted here