Update README.md
Browse files
README.md
CHANGED
|
@@ -5,17 +5,43 @@ tags:
|
|
| 5 |
- transformers
|
| 6 |
- unsloth
|
| 7 |
- gemma3n
|
| 8 |
-
license:
|
| 9 |
language:
|
| 10 |
- en
|
|
|
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
-
#
|
| 14 |
-
|
| 15 |
- **Developed by:** TitleOS
|
| 16 |
-
- **License:**
|
| 17 |
- **Finetuned from model :** unsloth/gemma-3n-e4b-it-unsloth-bnb-4bit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
-
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
|
| 5 |
- transformers
|
| 6 |
- unsloth
|
| 7 |
- gemma3n
|
| 8 |
+
license: mpl-2.0
|
| 9 |
language:
|
| 10 |
- en
|
| 11 |
+
datasets:
|
| 12 |
+
- acon96/Home-Assistant-Requests
|
| 13 |
---
|
| 14 |
|
| 15 |
+
# HomeGem4Bn
|
|
|
|
| 16 |
- **Developed by:** TitleOS
|
| 17 |
+
- **License:** mpl-2.0
|
| 18 |
- **Finetuned from model :** unsloth/gemma-3n-e4b-it-unsloth-bnb-4bit
|
| 19 |
+
HomeGem is a first generation finetune of Gemma 3n e4b IT, for use as a conversational LLM controlling your Home Assistant environment. Finetuning was performed on an A100 SXM4, and finetuned using the acon96/Home-Assistant-Requests dataset.
|
| 20 |
+
|
| 21 |
+
## Eval Results
|
| 22 |
+
```
|
| 23 |
+
Step 5: Displaying post-training statistics and evaluation loss...
|
| 24 |
+
2797.18 seconds used for training.
|
| 25 |
+
Peak reserved memory: 17.799 GB.
|
| 26 |
+
Peak memory for training: 8.42 GB.
|
| 27 |
+
|
| 28 |
+
--- Evaluation Loss Progression ---
|
| 29 |
+
Step 20: Eval Loss = 2.0582
|
| 30 |
+
Step 40: Eval Loss = 1.6810
|
| 31 |
+
Step 60: Eval Loss = 1.5477
|
| 32 |
+
Step 80: Eval Loss = 1.4737
|
| 33 |
+
Step 100: Eval Loss = 1.4113
|
| 34 |
+
Step 120: Eval Loss = 1.3982
|
| 35 |
+
Step 140: Eval Loss = 1.4340
|
| 36 |
+
Step 160: Eval Loss = 1.4325
|
| 37 |
+
Step 180: Eval Loss = 1.4424
|
| 38 |
+
Step 200: Eval Loss = 1.4442
|
| 39 |
|
| 40 |
+
--- Summary ---
|
| 41 |
+
Initial Eval Loss: 2.0582
|
| 42 |
+
Final Eval Loss: 1.4442
|
| 43 |
+
Improvement: 0.6140
|
| 44 |
+
---------------------------------
|
| 45 |
+
```
|
| 46 |
|
| 47 |
+
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|