Modelpublic

speakleash/Bielik-11B-v3.0-Instruct-MLX-8bit

sourceHugging Faceapache-2.0updated 8mo agoView on Hugging Face

3likes544downloads

Model Card

Bielik-11B-v3.0-Instruct-MLX-8bit

This model was converted to MLX format from SpeakLeash's Bielik-11B-v3.0-Instruct.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Use with mlx

bash

pip install mlx-lm

python

from mlx_lm import load, generate

model, tokenizer = load("speakleash/Bielik-11B-v3.0-Instruct-MLX-8bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)

Model description:

—Developed by: SpeakLeash & ACK Cyfronet AGH
—Language: Multilingual (32 European languages, optimized for Polish)
—Model type: causal decoder-only
—Quant from: Bielik-11B-v3.0-Instruct
—Finetuned from: speakleash/Bielik-11B-v3-Base-20250730
—License: Apache 2.0

Responsible for model quantization

—Remigiusz Kinas<sup>SpeakLeash</sup> - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.