---
license: apache-2.0
language:
  - en
library_name: transformers
tags:
  - mobile
  - on-device
  - quantized
  - gguf
  - dispatchai
pipeline_tag: text-generation
---

# Qwen2.5-Coder-7B-mobile

✅ **WORKS** — Verified June 2026.

## Verification Results

| Prompt | Response | Correct? |
|--------|----------|----------|
| What is the capital of France? | "The capital of France is Paris." | ✅ |
| What is 2+2? Just the number. | "4" | ✅ |


## Model Details

| Attribute | Value |
|-----------|-------|
| **Base Model** | Qwen/Qwen2.5-Coder-7B |
| **File Size** | 4466 MB |
| **Format** | GGUF |
| **Chat Format** | chatml |
| **CPU Speed** | 3.0 tokens/sec |
| **License** | apache-2.0 |

## Usage

```python
from llama_cpp import Llama

llm = Llama(model_path="model.gguf", chat_format="chatml", n_ctx=512, n_threads=4, verbose=False)
response = llm.create_chat_completion(
    messages=[{"role": "user", "content": "What is the capital of France?"}],
    max_tokens=50,
)
print(response["choices"][0]["message"]["content"])
```

### dispatchAI SDK
```python
from dispatchai import load_model
model = load_model("Qwen2.5-Coder-7B-mobile", backend="gguf")
print(model.chat("Hello!"))
```

🚀 [dispatchAI](https://huggingface.co/dispatchAI)