CoolFace
Modelpublic

sayhan/Mistral-7B-Instruct-v0.2-turkish-GGUF

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face
9likes588downloads
Model Card

Mistral 7B Instruct v0.2 Turkish

<!-- description start -->

Description

This repo contains GGUF format model files for malhajar's Mistral 7B Instruct v0.2 Turkish

Original model

Quantization methods

quantization methodbitssizeuse caserecommended
Q2_K22.72 GBsmallest, significant quality loss❌
Q3KS33.16 GBvery small, high quality loss❌
Q3KM33.52 GBvery small, high quality loss❌
Q3KL33.82 GBsmall, substantial quality loss❌
Q4_044.11 GBlegacy; small, very high quality loss❌
Q4KS44.14 GBsmall, greater quality loss❌
Q4KM44.37 GBmedium, balanced quality✅
Q5_055.00 GBlegacy; medium, balanced quality❌
Q5KS55.00 GBlarge, low quality loss✅
Q5KM55.13 GBlarge, very low quality loss✅
Q6_K65.94 GBvery large, extremely low quality loss❌
Q8_087.70 GBvery large, extremely low quality loss❌
FP161614.5 GBenormous, minuscule quality loss❌

Prompt Template

### Instruction:
<prompt> (without the <>)
### Response:

<!-- description end -->