dispatchAI/mobile-agent
0
๐ค dispatchAI Mobile Agent
A real AI agent running on a 1B parameter model โ small enough for your pocket.
This Space proves that useful AI agents can run on phone-sized models. The agent is powered by Llama-3.2-1B-Instruct-Q4-mobile โ a 1B parameter model quantized to 4-bit, with a 700MB file size that runs at 18 tokens/sec on a Snapdragon 865.
Features
- ๐ฌ Chat โ Conversational AI on a 1B model
- ๐จโ๐ป Code generation โ Python code from natural language
- ๐ง MCP server โ Add this agent as a tool in Claude Desktop / Cursor
The Point
This isn't about matching GPT-4. It's about proving that a 1B model on a phone can be genuinely useful. For the tasks people actually do on phones โ quick answers, code snippets, summaries, classifications โ a 1B model is enough.
Run On Your Phone
hf download dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile model.gguf
llama-cli -m model.gguf -p "Hello!" -n 100 -t 4๐ dispatchAI โ Small. Mobile. Free. UAE-built.
