Yusiko commited on
Commit
41e5705
·
verified ·
1 Parent(s): b91f5ee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +66 -8
README.md CHANGED
@@ -3,16 +3,74 @@ tags:
3
  - gguf
4
  - llama.cpp
5
  - unsloth
6
-
 
 
 
 
 
 
 
7
  ---
8
 
9
- # LIA - GGUF
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
- This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth).
 
 
 
12
 
13
- **Example usage**:
14
- - For text only LLMs: **llama-cli** **--hf** repo_id/model_name **-p** "why is the sky blue?"
15
- - For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf
 
 
16
 
17
- ## Available Model files:
18
- - `meta-llama-3.1-8b.Q4_K_M.gguf`
 
3
  - gguf
4
  - llama.cpp
5
  - unsloth
6
+ license: mit
7
+ datasets:
8
+ - Yusiko/lia_dataset
9
+ language:
10
+ - az
11
+ - en
12
+ base_model:
13
+ - meta-llama/Llama-3.1-8B
14
  ---
15
 
16
+ # 🤓LIA (Llama 3.1 8B — Finetuned with Unsloth)
17
+
18
+ A finetuned Llama 3.1 8B model specialized for Local Intelligent Agent (LIA) intent parsing and local file/system actions. The model converts user requests into compact JSON that LIA executes safely.
19
+
20
+ ## Overview🧐
21
+ - Base: Llama 3.1 8B Instruct
22
+ - Method: Unsloth SFT (LoRA), merged for deployment
23
+ - Dataset: Custom, user-created (intent pairs)
24
+ - Output: Raw JSON only (no markdown), with keys: command_type, parameters, reasoning
25
+ - Primary goal: Deterministic intent parsing for desktop automation
26
+
27
+ ## 😎Purpose and Tasks
28
+ - Parse file/folder operations: open, list, create, write, read, delete, copy, move, rename
29
+ - Interpret patterns (e.g., *.pdf) and paths
30
+ - Safe fallback to `chat` intent when not a file operation
31
+ - Produce stable JSON without code fences or extra prose
32
+
33
+ Example output:
34
+ ```json
35
+ {
36
+ "command_type": "list_files",
37
+ "parameters": {"path": "Downloads", "pattern": "*.pdf"},
38
+ "reasoning": "User wants to list PDFs in Downloads"
39
+ }
40
+ ```
41
+
42
+ ## 😲Differences vs Original Llama 3.1 8B
43
+ - More consistent JSON-only answers for intent parsing
44
+ - Lower hallucination rate on file/command names
45
+ - Better handling of short/telegraphic commands
46
+ - Tuned for low temperature decoding (0.1–0.3)
47
+
48
+ ## Training (Unsloth)
49
+ - LoRA-based SFT on user dataset (input → JSON output pairs)
50
+ - Chat template aligned with Llama 3.1
51
+ - System prompt stresses: “Return raw JSON only”
52
+ - Adapters merged to a full checkpoint for serving
53
+
54
+ ## Using with Ollama
55
+ Model reference: `hf.co/Yusiko/LIA`
56
+
57
+ Modelfile:
58
+ ```Dockerfile
59
+ FROM hf.co/Yusiko/LIA
60
+ PARAMETER temperature 0.2
61
+ PARAMETER num_ctx 4096
62
+ SYSTEM You are an intent parser for a local agent. Reply with raw JSON only: keys command_type, parameters, reasoning. No markdown.
63
+ ```
64
 
65
+ Quick start (Ollama):
66
+ ```bash
67
+ ollama run hf.co/Yusiko/LIA:Q4_K_M
68
+ ```
69
 
70
+ ## 📃License and Credits
71
+ - Base: Meta Llama 3.1 8B Instruct (respect base license)
72
+ - Finetuning: Unsloth
73
+ - Packaging: Ollama
74
+ - LIA is protecting with MIT license
75
 
76
+ For questions or integration help, open an issue on the repository.