Update README.md
Browse files
README.md
CHANGED
|
@@ -3,16 +3,74 @@ tags:
|
|
| 3 |
- gguf
|
| 4 |
- llama.cpp
|
| 5 |
- unsloth
|
| 6 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
---
|
| 8 |
|
| 9 |
-
# LIA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
-
|
| 14 |
-
-
|
| 15 |
-
-
|
|
|
|
|
|
|
| 16 |
|
| 17 |
-
|
| 18 |
-
- `meta-llama-3.1-8b.Q4_K_M.gguf`
|
|
|
|
| 3 |
- gguf
|
| 4 |
- llama.cpp
|
| 5 |
- unsloth
|
| 6 |
+
license: mit
|
| 7 |
+
datasets:
|
| 8 |
+
- Yusiko/lia_dataset
|
| 9 |
+
language:
|
| 10 |
+
- az
|
| 11 |
+
- en
|
| 12 |
+
base_model:
|
| 13 |
+
- meta-llama/Llama-3.1-8B
|
| 14 |
---
|
| 15 |
|
| 16 |
+
# 🤓LIA (Llama 3.1 8B — Finetuned with Unsloth)
|
| 17 |
+
|
| 18 |
+
A finetuned Llama 3.1 8B model specialized for Local Intelligent Agent (LIA) intent parsing and local file/system actions. The model converts user requests into compact JSON that LIA executes safely.
|
| 19 |
+
|
| 20 |
+
## Overview🧐
|
| 21 |
+
- Base: Llama 3.1 8B Instruct
|
| 22 |
+
- Method: Unsloth SFT (LoRA), merged for deployment
|
| 23 |
+
- Dataset: Custom, user-created (intent pairs)
|
| 24 |
+
- Output: Raw JSON only (no markdown), with keys: command_type, parameters, reasoning
|
| 25 |
+
- Primary goal: Deterministic intent parsing for desktop automation
|
| 26 |
+
|
| 27 |
+
## 😎Purpose and Tasks
|
| 28 |
+
- Parse file/folder operations: open, list, create, write, read, delete, copy, move, rename
|
| 29 |
+
- Interpret patterns (e.g., *.pdf) and paths
|
| 30 |
+
- Safe fallback to `chat` intent when not a file operation
|
| 31 |
+
- Produce stable JSON without code fences or extra prose
|
| 32 |
+
|
| 33 |
+
Example output:
|
| 34 |
+
```json
|
| 35 |
+
{
|
| 36 |
+
"command_type": "list_files",
|
| 37 |
+
"parameters": {"path": "Downloads", "pattern": "*.pdf"},
|
| 38 |
+
"reasoning": "User wants to list PDFs in Downloads"
|
| 39 |
+
}
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
## 😲Differences vs Original Llama 3.1 8B
|
| 43 |
+
- More consistent JSON-only answers for intent parsing
|
| 44 |
+
- Lower hallucination rate on file/command names
|
| 45 |
+
- Better handling of short/telegraphic commands
|
| 46 |
+
- Tuned for low temperature decoding (0.1–0.3)
|
| 47 |
+
|
| 48 |
+
## Training (Unsloth)
|
| 49 |
+
- LoRA-based SFT on user dataset (input → JSON output pairs)
|
| 50 |
+
- Chat template aligned with Llama 3.1
|
| 51 |
+
- System prompt stresses: “Return raw JSON only”
|
| 52 |
+
- Adapters merged to a full checkpoint for serving
|
| 53 |
+
|
| 54 |
+
## Using with Ollama
|
| 55 |
+
Model reference: `hf.co/Yusiko/LIA`
|
| 56 |
+
|
| 57 |
+
Modelfile:
|
| 58 |
+
```Dockerfile
|
| 59 |
+
FROM hf.co/Yusiko/LIA
|
| 60 |
+
PARAMETER temperature 0.2
|
| 61 |
+
PARAMETER num_ctx 4096
|
| 62 |
+
SYSTEM You are an intent parser for a local agent. Reply with raw JSON only: keys command_type, parameters, reasoning. No markdown.
|
| 63 |
+
```
|
| 64 |
|
| 65 |
+
Quick start (Ollama):
|
| 66 |
+
```bash
|
| 67 |
+
ollama run hf.co/Yusiko/LIA:Q4_K_M
|
| 68 |
+
```
|
| 69 |
|
| 70 |
+
## 📃License and Credits
|
| 71 |
+
- Base: Meta Llama 3.1 8B Instruct (respect base license)
|
| 72 |
+
- Finetuning: Unsloth
|
| 73 |
+
- Packaging: Ollama
|
| 74 |
+
- LIA is protecting with MIT license
|
| 75 |
|
| 76 |
+
For questions or integration help, open an issue on the repository.
|
|
|