mozilla-ai/Mistral-7B-Instruct-v0.2-llamafile

Quantize Q5_K_S with llamafile-0.8.5

Quantize Q4_K_M with llamafile-0.8.5

Quantize Q4_K_S with llamafile-0.8.5

Quantize Q3_K_L with llamafile-0.8.5

Quantize Q3_K_M with llamafile-0.8.5

Quantize Q3_K_S with llamafile-0.8.5

Quantize Q2_K with llamafile-0.8.5

Quantize Q5_1 with llamafile-0.8.5

Quantize Q5_0 with llamafile-0.8.5

Quantize Q4_1 with llamafile-0.8.5

Quantize Q4_0 with llamafile-0.8.5

Quantize Q6_K with llamafile-0.8.5

Quantize BF16 with llamafile-0.8.5

Quantize F16 with llamafile-0.8.5

Quantize Q8_0 with llamafile-0.8.5

Quantize Q5_K_M with llamafile-0.8.5

Update README.md

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q3_K_L

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q3_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q3_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q2_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q6_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 BF16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.3 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_L

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_M

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_S

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q2_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_0

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_1