Modelpublic

cagataydev/Qwen2.5-Omni-3B-cagatay-4bit

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face

0likes23downloads

Model Card

🌐 Q-Omni MLX — Qwen 2.5 3B Cagatay (4-bit)

A 4-bit quantized MLX model for Apple Silicon — fine-tuned for voice commands and robotics reasoning.

6.2 GB → 1.7 GB | 4-bit | Runs on MacBook Air

🚀 Use with Strands Agents + MLX

python

from strands import Agent
from strands_mlx import MLXModel

model = MLXModel(model_id="cagataydev/Qwen2.5-Omni-3B-cagatay-4bit")
agent = Agent(model=model)
agent("Listen to the voice command and plan the robot's next action")

📊 Model Details

Property	Value
Base Model	Qwen/Qwen2.5-3B-Instruct
Fine-tune	cagataydev/qwen2.5-omni-3b-cagatay (LoRA)
Quantization	4-bit MLX (group size 64)
Size	1.7 GB
Platform	Apple Silicon (M1/M2/M3/M4)

📦 Q-Model Family

Model	Size	Quantized	Use Case
🌐 Q-Omni (this)	3B	1.7 GB	Voice & multimodal
🐤 Q-Tiny	4B	2.4 GB	Task planning
🧠 Q-Brain	35B MoE	—	Complex reasoning

Built with [DevDuck](https://github.com/cagataycali/devduck) 🦆 and [Strands Agents](https://strandsagents.com) 🧬