LiquidAI/LFM2.5-VL-3B-MLX-8bit
<div align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png" alt="Liquid AI" style="width: 100%; max-width: 100%;">
<p> <a href="https://playground.liquid.ai/"><strong>Try LFM</strong></a> • <a href="https://docs.liquid.ai/lfm"><strong>Documentation</strong></a> • <a href="https://leap.liquid.ai/"><strong>LEAP</strong></a> • <a href="https://www.liquid.ai/blog/"><strong>Blog</strong></a> </p> </div>
LFM2.5-VL-3B-MLX-8bit
MLX export of LFM2.5-VL-3B for Apple Silicon inference.
LFM2.5-VL-3B is a vision-language model built on the LFM2.5-2.6B backbone with a SigLIP2 NaFlex vision encoder (400M). It supports OCR, document comprehension, multilingual vision understanding, bounding box prediction, and function calling.
Quickstart
uv run --with mlx-vlm mlx_vlm.generate --model LiquidAI/LFM2.5-VL-3B-MLX-8bit --max-tokens 100 --temperature 0.2 --image https://placecats.com/neo/300/200 --prompt "how many animals are in the picture?"from mlx_vlm import apply_chat_template, generate, load
from mlx_vlm.utils import load_image
model, processor = load("LiquidAI/LFM2.5-VL-3B-MLX-8bit")
image = load_image("https://placecats.com/neo/300/200")
messages = [
{
"role": "user",
"content": [
{"type": "image"},
{"type": "text", "text": "What do you see in this image?"},
],
}
]
prompt = apply_chat_template(
processor,
model.config,
messages,
add_generation_prompt=True,
num_images=1,
)
result = generate(
model,
processor,
prompt,
[image],
temp=0.2,
top_k=50,
repetition_penalty=1.0,
verbose=True,
)
print(result.text)