Modelpublic

vanch007/Huihui-MiniCPM-V-4.6-abliterated-mlx-bf16

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

2likes87downloads

Model Card

Huihui-MiniCPM-V-4.6-abliterated-mlx-bf16

Converted from `huihui-ai/Huihui-MiniCPM-V-4.6-abliterated` with mlx-vlm from the current main branch.

Conversion

—Source: huihui-ai/Huihui-MiniCPM-V-4.6-abliterated
—Format: MLX
—Quantization: bfloat16
—Processor files: processor_config.json + preprocessor_config.json

Smoke test

—Prompt: Describe this image in one sentence.
—Image: 64x64 solid red PNG
—Result: The image is a solid red color, with no discernible features or objects.

Usage

bash

python -m mlx_vlm.generate --model vanch007/Huihui-MiniCPM-V-4.6-abliterated-mlx-bf16 --max-tokens 32 --temperature 0.0 --trust-remote-code --prompt "Describe this image in one sentence." --image <path_to_image>