CoolFace
Apppublic

dispatchAI/mobile-agent

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
0likes
App README

๐Ÿค– dispatchAI Mobile Agent

A real AI agent running on a 1B parameter model โ€” small enough for your pocket.

This Space proves that useful AI agents can run on phone-sized models. The agent is powered by Llama-3.2-1B-Instruct-Q4-mobile โ€” a 1B parameter model quantized to 4-bit, with a 700MB file size that runs at 18 tokens/sec on a Snapdragon 865.

Features

  • โ€”๐Ÿ’ฌ Chat โ€” Conversational AI on a 1B model
  • โ€”๐Ÿ‘จโ€๐Ÿ’ป Code generation โ€” Python code from natural language
  • โ€”๐Ÿ”ง MCP server โ€” Add this agent as a tool in Claude Desktop / Cursor

The Point

This isn't about matching GPT-4. It's about proving that a 1B model on a phone can be genuinely useful. For the tasks people actually do on phones โ€” quick answers, code snippets, summaries, classifications โ€” a 1B model is enough.

Run On Your Phone

bash
hf download dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile model.gguf
llama-cli -m model.gguf -p "Hello!" -n 100 -t 4

๐Ÿš€ dispatchAI โ€” Small. Mobile. Free. UAE-built.