Modelpublic

Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes241downloads

Model Card

Run this on your Mac with [Outlier](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=qwen3_coder_30b_a3b_instruct_mlx_4bit) — a one-click app that loads MLX models locally. macOS arm64, free download.

Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit)

MLX 4-bit conversion of `Qwen/Qwen3-Coder-30B-A3B-Instruct`, repackaged for Apple Silicon. Original weights, original license — see frontmatter above. This repo only changes the on-disk format (safetensors, MLX 4-bit, chat_template.jinja, tokenizer).

About this conversion

—Format: MLX 4-bit safetensors (group size 64, symmetric)
—Tooling: mlx-lm 0.31.x compatible
—Files: model.safetensors shards · config.json · tokenizer · chat_template.jinja
—License: inherits from the upstream base model — see YAML license field

Load directly with `mlx-lm`

bash

pip install mlx-lm
python -m mlx_lm.generate \
  --model Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit \
  --prompt "Hello, world." \
  --max-tokens 256

Or in Python:

python

from mlx_lm import load, generate
model, tokenizer = load("Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit")
print(generate(model, tokenizer, prompt="Hello, world.", max_tokens=256))

What is Outlier?

Outlier is a free macOS app that runs language models on your Mac, fully offline. Pick a model from a tier picker, click download, and chat — no API keys, no cloud round-trips, no usage caps. It ships with its own curated tier of MLX-4bit models and can also load any compatible MLX conversion (including this one) via the model picker.

➡ Download Outlier (free, Apple Silicon): [outlier.host](https://outlier.host/?utm_source=hf&utm_medium=modelcard&utm_campaign=qwen3_coder_30b_a3b_instruct_mlx_4bit)

For benchmark numbers (MMLU, HumanEval, tok/s on M-series Macs) with full provenance, see outlier.host/benchmarks.

Other Outlier conversions

License