---
license: mit
language:
  - en
library_name: transformers
tags:
  - mobile
  - on-device
  - quantized
  - gguf
  - dispatchai
pipeline_tag: text-generation
---

# Phi-3.5-mini-Instruct-mobile

✅ **WORKS** — Verified June 2026.

## Verification Results

| Prompt | Response | Correct? |
|--------|----------|----------|
| What is the capital of France? | "The capital of France is Paris. It is not only the largest c" | ✅ |
| What is 2+2? Just the number. | "The sum of 2 and 2 is 4. This is a basic arithmetic operatio" | ✅ |


## Model Details

| Attribute | Value |
|-----------|-------|
| **Base Model** | microsoft/Phi-3.5-mini-instruct |
| **File Size** | 2282 MB |
| **Format** | GGUF |
| **Chat Format** | chatml |
| **CPU Speed** | 8.6 tokens/sec |
| **License** | mit |

## Usage

```python
from llama_cpp import Llama

llm = Llama(model_path="model.gguf", chat_format="chatml", n_ctx=512, n_threads=4, verbose=False)
response = llm.create_chat_completion(
    messages=[{"role": "user", "content": "What is the capital of France?"}],
    max_tokens=50,
)
print(response["choices"][0]["message"]["content"])
```

### dispatchAI SDK
```python
from dispatchai import load_model
model = load_model("Phi-3.5-mini-Instruct-mobile", backend="gguf")
print(model.chat("Hello!"))
```

🚀 [dispatchAI](https://huggingface.co/dispatchAI)