Spaces:
Runtime error
Runtime error
A newer version of the Gradio SDK is available: 6.19.0
metadata
title: Mobile Agent
emoji: π€
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: true
license: apache-2.0
tags:
- agent
- mobile
- on-device
- smolagents
- mcp
- dispatchai
models:
- dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile
π€ dispatchAI Mobile Agent
A real AI agent running on a 1B parameter model β small enough for your pocket.
This Space proves that useful AI agents can run on phone-sized models. The agent is powered by Llama-3.2-1B-Instruct-Q4-mobile β a 1B parameter model quantized to 4-bit, with a 700MB file size that runs at 18 tokens/sec on a Snapdragon 865.
Features
- π¬ Chat β Conversational AI on a 1B model
- π¨βπ» Code generation β Python code from natural language
- π§ MCP server β Add this agent as a tool in Claude Desktop / Cursor
The Point
This isn't about matching GPT-4. It's about proving that a 1B model on a phone can be genuinely useful. For the tasks people actually do on phones β quick answers, code snippets, summaries, classifications β a 1B model is enough.
Run On Your Phone
hf download dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile model.gguf
llama-cli -m model.gguf -p "Hello!" -n 100 -t 4
π dispatchAI β Small. Mobile. Free. UAE-built.