File size: 2,617 Bytes
9284513 0532581 9284513 2688dfb 9284513 2688dfb 9284513 2688dfb 9284513 2688dfb 9284513 2688dfb 9284513 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 | ---
license: apache-2.0
---
# IcaroLM
IcaroLM is a fine-tuned and quantized version of Qwen2 1.5B, designed specifically for on-device mobile applications. By leveraging a 1.5B parameter architecture and quantization, the model is approximately **600MB** in size, making it practical for local deployment on smartphones and edge devices without requiring cloud connectivity.
IcaroLM has been fine-tuned for two primary objectives: maintaining emotionally intelligent conversations and executing reliable function calls within a chat flow.
## Key Features
- **Mobile-Ready Footprint:** The quantized model is roughly 600MB, allowing for efficient storage and inference on consumer mobile hardware.
- **Function Calling:** Explicitly fine-tuned to understand and execute function calls, enabling local task automation and tool use.
- **Empathetic Chat:** Trained on datasets curated for emotional intelligence, allowing for more natural and supportive interactions compared to base models.
## Use Cases
- **Mobile Assistants:** Local chatbots that can perform actions on the device (via function calling) without sending data to the server.
- **Emotional Support Apps:** Companion applications requiring a more empathetic and nuanced conversational tone.
- **Edge Automation:** Task-oriented agents that need to run locally with low latency.
## Prompt format
```
<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
## Function calling example
```
<|im_start|>system
You are a helpful assistant with access to the following functions. Use them if required -[{
"name":"get_news",
"description":"Get the latest news.",
"parameters":{
"type":"object",
"properties":{
"location":{
"type":"string",
"description":"The location for which to fetch news"
}
},
"required":[
"location"
]
}
},
{
"name": "get_current_weather",
"description": "Get the current weather",
"parameters": {
"type": "object",
"properties": {
"location": {
"type": "string",
"description": "The city and state, e.g. San Francisco, CA"
},
},
"required": ["location"],
},
}]<|im_end|>
<|im_start|>user
What's the latest news in Samara?<|im_end|>
<|im_start|>assistant
```
Result:
```
<|im_start|>assistant
<functioncall> {"name": "get_news", "arguments": '{"location": "Samara"}'} <|im_end|>
```
|