DreamFoundries/Qwen3-VL-4B-Instruct-3bit

Qwen3-VL-4B-Instruct-3bit (repaired)


Re-upload of mlx-community/Qwen3-VL-4B-Instruct-3bit with one fix: the upstream repo ships a stale model.safetensors.index.json describing a 2-shard bf16 checkpoint (model-00001-of-00002.safetensors / model-00002-of-00002.safetensors) that does not exist in that repo — only a single consolidated model.safetensors (3-bit, MLX format, 1219 tensors) is actually present. Any loader that trusts the index blindly (mlx-swift-lm's safetensorWeightURLs, among others) fails trying to open a shard that was never there, and no re-download fixes it since the missing files simply don't exist upstream.

This repo removes the stale index. Weights are otherwise byte-identical to upstream — same single model.safetensors, same digest.

All credit for the conversion to MLX and the 3-bit quantization goes to mlx-community. All credit for the base model goes to the Qwen team (Apache-2.0).

Usage

pip install -U mlx-vlm
python -m mlx_vlm.generate --model DreamFoundries/Qwen3-VL-4B-Instruct-3bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>

Or open directly in MLXHub on iOS/iPadOS via the badge above.