hub / app.py
3morixd's picture
Upload app.py with huggingface_hub
81bc5a7 verified
Raw
History Blame Contribute Delete
2.54 kB
import gradio as gr
with gr.Blocks(theme=gr.themes.Soft(primary_hue="blue"), title="dispatchAI Hub") as demo:
gr.Markdown("""
# ๐Ÿš€ dispatchAI Hub
**Small. Mobile. Free. UAE-built.**
31 verified working models. 0 broken. 0 partial. All tested.
---
## ๐Ÿ“ฆ Models (36 total)
| Category | Count | Link |
|----------|-------|------|
| Working chat models | 31 | [Browse](https://huggingface.co/dispatchAI) |
| Embedding models | 2 | [Collection](https://huggingface.co/dispatchAI/collections) |
| Non-chat (ASR) | 3 | โ€” |
| Broken | 0 | โ€” |
## ๐ŸŽฎ Demos
| Demo | Link |
|------|------|
| Mobile Chat | [Open](https://huggingface.co/spaces/dispatchAI/mobile-chat-demo) |
| Mobile Agent (1B) | [Open](https://huggingface.co/spaces/dispatchAI/mobile-agent) |
| Function Calling | [Open](https://huggingface.co/spaces/dispatchAI/function-calling-agent) |
| Quant Playground | [Open](https://huggingface.co/spaces/dispatchAI/quant-playground) |
| Leaderboard | [Open](https://huggingface.co/spaces/dispatchAI/mobile-llm-leaderboard) |
| Cost Calculator | [Open](https://huggingface.co/spaces/dispatchAI/phone-vs-cloud) |
| Model Recommender | [Open](https://huggingface.co/spaces/dispatchAI/model-recommender) |
| GGUF Converter | [Open](https://huggingface.co/spaces/dispatchAI/gguf-converter) |
| Safety Classifier | [Open](https://huggingface.co/spaces/dispatchAI/mcp-safety-classifier) |
| Tokenizer Visualizer | [Open](https://huggingface.co/spaces/dispatchAI/tokenizer-visualizer) |
## ๐Ÿงฐ MCP Tools
```json
{"mcpServers":{"dispatchai":{"url":"https://huggingface.co/spaces/dispatchAI/mcp-hub/mcp"}}}
```
## ๐Ÿ”ง SDK
```bash
pip install dispatchai
```
```python
from dispatchai import load_model
model = load_model("SmolLM2-135M-Instruct-mobile", backend="gguf")
print(model.chat("What is the capital of France?"))
```
## ๐Ÿ“ฑ Phone-Verified (Snapdragon 865)
| Model | Size | Speed |
|-------|------|-------|
| SmolLM2-135M | 101MB | 46.0 t/s |
| Qwen2.5-0.5B-int4 | 469MB | 23.2 t/s |
| Llama-3.2-1B-Q4 | 770MB | 5.4 t/s |
---
Dispatch AI (FZE) โ€” Sharjah, UAE. License No. 10818.
๐ŸŒ [dispatchai.ai](https://www.dispatchai.ai) | ๐Ÿค— [huggingface.co/dispatchAI](https://huggingface.co/dispatchAI)
*I think, therefore I ship.*
""")
demo.launch()