Modelpublic

beshkenadze/moondream3-preview-mlx-4bit

sourceHugging Faceotherupdated 4mo agoView on Hugging Face

2likes228downloads

Model Card

moondream3-preview-mlx-4bit

A 4-bit MLX quantization of moondream/moondream3-preview for running on Apple Silicon with mlx-vlm.


Quantization	affine, 4 bits, group size 64 (vision tower included)
On-disk size	~5 GB
Peak memory	~6.5 GB
Tokenizer	loaded from `moondream/starmie-v1` at runtime (not bundled)

Usage

bash

pip install mlx-vlm

python -m mlx_vlm.generate \
  --model beshkenadze/moondream3-preview-mlx-4bit \
  --image path/to/image.jpg \
  --prompt "Describe this image." \
  --max-tokens 128 --temperature 0.0

License

moondream3 is released under the Business Source License 1.1 (BSL 1.1) — see LICENSE.md. This quantization is a derivative redistribution under the same terms.