Spaces:

dispatchAI
/

mobile-chat-demo

Runtime error

App Files Files Community

mobile-chat-demo / README.md

3morixd

Upload README.md with huggingface_hub

5fca600 verified 7 days ago

preview code

Raw

History Blame Contribute Delete

1.23 kB

A newer version of the Gradio SDK is available: 6.19.0

Upgrade

metadata

title: Mobile Chat Demo
emoji: 🚀
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: true
license: apache-2.0
tags:
  - mobile
  - llm
  - on-device
  - dispatchai
models:
  - dispatchAI/SmolLM2-135M-Instruct-mobile

🚀 dispatchAI Mobile Chat Demo

Chat with dispatchAI's mobile-optimized models directly in your browser.

Model: SmolLM2-135M-Instruct-mobile — 135M parameters, under 500MB, designed to run on phones.

This Space runs on ZeroGPU (Team tier) so it stays responsive even under load.

Try It

Just type a message and chat. The model is small but surprisingly capable for its size.

Run This Model On Your Phone

from transformers import AutoTokenizer, AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("dispatchAI/SmolLM2-135M-Instruct-mobile")
tokenizer = AutoTokenizer.from_pretrained("dispatchAI/SmolLM2-135M-Instruct-mobile")

Or with llama.cpp:

llama-cli -m model.gguf -p "Hello!" -n 100

About dispatchAI

We re-engineer open-source LLMs for mobile and edge devices. 39 models, all tested on real Snapdragon hardware, all free.

🌐 dispatchAI on HuggingFace