Modelpublic

translate-studio/PaddleOCR-VL-1.6-6bit

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes148downloads

Model Card

PaddleOCR-VL-1.6 — 6-bit (MLX)

A 6-bit, group-size-64 MLX quantization of `PaddlePaddle/PaddleOCR-VL-1.6`, for fast on-device OCR on Apple Silicon. The architecture is unchanged — this repo only re-quantizes the original weights.

This is the size/quality sweet spot: in side-by-side OCR benchmarking it matches the 8-bit variant's quality, and — unlike 4-bit — it does not slip into repetition / hallucination loops on hard scripts, at a smaller footprint than 8-bit.


Base model	`PaddlePaddle/PaddleOCR-VL-1.6`
Quantization	6-bit, group size 64, affine (≈7.9 bits/weight)
Format	MLX `safetensors`
Size	~0.9 GB

Other tiers: 8-bit (slightly larger, same quality) and 4-bit (smallest, but prone to loops on hard/rare scripts).

License & attribution

Apache-2.0, inherited from the base model. All credit for the model goes to the PaddlePaddle / PaddleOCR team — this repository only provides an MLX-quantized copy.