CoolFace
Modelpublic

RichardErkhov/inswave_-_AISquare-Instruct-llama2-koen-13b-v0.9.8-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes858downloads
Model Card

Quantization made by Richard Erkhov.

Github

Discord

Request more models

AISquare-Instruct-llama2-koen-13b-v0.9.8 - GGUF

  • —Model creator: https://huggingface.co/inswave/
  • —Original model: https://huggingface.co/inswave/AISquare-Instruct-llama2-koen-13b-v0.9.8/
NameQuant methodSize
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q2_K.ggufQ2_K4.6GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.IQ3_XS.ggufIQ3_XS5.08GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.IQ3_S.ggufIQ3_S5.36GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q3_K_S.ggufQ3KS5.36GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.IQ3_M.ggufIQ3_M5.66GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q3_K.ggufQ3_K5.99GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q3_K_M.ggufQ3KM5.99GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q3_K_L.ggufQ3KL6.54GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.IQ4_XS.ggufIQ4_XS6.63GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q4_0.ggufQ4_06.95GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.IQ4_NL.ggufIQ4_NL7.0GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q4_K_S.ggufQ4KS7.01GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q4_K.ggufQ4_K7.42GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q4_K_M.ggufQ4KM7.42GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q4_1.ggufQ4_17.71GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q5_0.ggufQ5_08.46GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q5_K_S.ggufQ5KS8.46GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q5_K.ggufQ5_K8.7GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q5_K_M.ggufQ5KM8.7GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q5_1.ggufQ5_19.21GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q6_K.ggufQ6_K10.06GB
AISquare-Instruct-llama2-koen-13b-v0.9.8.Q8_0.ggufQ8_013.03GB

Original model description: Entry not found