CoolFace
Modelpublic

QuantFactory/starcoder2-7b-instruct-GGUF

sourceHugging Facebigcode-openrail-mupdated 2y agoView on Hugging Face
2likes1.6kdownloads
filestarcoder2-7b-instruct.Q2_K.gguf2.64 GBdownload
filestarcoder2-7b-instruct.Q3_K_L.gguf3.79 GBdownload
filestarcoder2-7b-instruct.Q3_K_M.gguf3.41 GBdownload
filestarcoder2-7b-instruct.Q3_K_S.gguf2.96 GBdownload
filestarcoder2-7b-instruct.Q4_0.gguf3.82 GBdownload
filestarcoder2-7b-instruct.Q4_1.gguf4.22 GBdownload
filestarcoder2-7b-instruct.Q4_K_M.gguf4.15 GBdownload
filestarcoder2-7b-instruct.Q4_K_S.gguf3.86 GBdownload
filestarcoder2-7b-instruct.Q5_0.gguf4.63 GBdownload
filestarcoder2-7b-instruct.Q5_1.gguf5.03 GBdownload
filestarcoder2-7b-instruct.Q5_K_M.gguf4.80 GBdownload
filestarcoder2-7b-instruct.Q5_K_S.gguf4.63 GBdownload
filestarcoder2-7b-instruct.Q6_K.gguf5.49 GBdownload
filestarcoder2-7b-instruct.Q8_0.gguf7.10 GBdownload

QuantFactory/starcoder2-7b-instruct-GGUF · main · files are served by the source, never re-hosted here