mozilla-ai/Phi-3-mini-4k-instruct-llamafile

Quantize BF16 with llamafile-0.8.9

Quantize Q6_K with llamafile-0.8.9

Quantize Q5_K_M with llamafile-0.8.9

Quantize Q5_K_S with llamafile-0.8.9

Quantize Q4_K_M with llamafile-0.8.9

Quantize Q4_K_S with llamafile-0.8.9

Quantize Q3_K_L with llamafile-0.8.9

Quantize Q3_K_M with llamafile-0.8.9

Quantize Q3_K_S with llamafile-0.8.9

Quantize Q2_K with llamafile-0.8.9

Quantize Q5_1 with llamafile-0.8.9

Quantize Q5_0 with llamafile-0.8.9

Quantize Q4_1 with llamafile-0.8.9

Quantize F16 with llamafile-0.8.9

Quantize Q8_0 with llamafile-0.8.9

Quantize Q4_0 with llamafile-0.8.9

Quantize BF16 with llamafile-0.8.8

Quantize Q6_K with llamafile-0.8.8

Quantize Q5_K_M with llamafile-0.8.8

Quantize Q5_K_S with llamafile-0.8.8

Quantize Q4_K_M with llamafile-0.8.8

Quantize Q4_K_S with llamafile-0.8.8

Quantize Q3_K_L with llamafile-0.8.8

Quantize Q3_K_M with llamafile-0.8.8

Quantize Q3_K_S with llamafile-0.8.8

Quantize Q2_K with llamafile-0.8.8

Quantize Q5_1 with llamafile-0.8.8

Quantize Q5_0 with llamafile-0.8.8

Quantize Q4_1 with llamafile-0.8.8

Quantize F16 with llamafile-0.8.8

Quantize Q8_0 with llamafile-0.8.8

Quantize Q4_0 with llamafile-0.8.8

Quantize BF16 with llamafile-0.8.7

Quantize Q6_K with llamafile-0.8.7

Quantize Q5_K_M with llamafile-0.8.7

Quantize Q5_K_S with llamafile-0.8.7

Quantize Q4_K_M with llamafile-0.8.7

Quantize Q4_K_S with llamafile-0.8.7

Quantize Q3_K_L with llamafile-0.8.7

Quantize Q3_K_M with llamafile-0.8.7

Quantize Q3_K_S with llamafile-0.8.7

Quantize Q2_K with llamafile-0.8.7

Quantize Q5_1 with llamafile-0.8.7

Quantize Q5_0 with llamafile-0.8.7

Quantize Q4_1 with llamafile-0.8.7

Quantize F16 with llamafile-0.8.7

Quantize Q8_0 with llamafile-0.8.7

Quantize Q4_0 with llamafile-0.8.7

Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 BF16

Quantize Phi-3-mini-4k-instruct with llamafile-0.8.4 Q6_K