File size: 1,396 Bytes
63a1a80
 
 
 
 
 
 
83c32d3
63a1a80
 
83c32d3
 
63a1a80
 
83c32d3
63a1a80
83c32d3
63a1a80
6b6c354
 
83c32d3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
63a1a80
83c32d3
 
 
 
 
 
63a1a80
83c32d3
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
---
base_model: unsloth/gemma-3n-e4b-it-unsloth-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- gemma3n
license: mpl-2.0
language:
- en
datasets:
- acon96/Home-Assistant-Requests
---

# HomeGem4Bn
- **Developed by:** TitleOS
- **License:** mpl-2.0
- **Finetuned from model :** unsloth/gemma-3n-e4b-it-unsloth-bnb-4bit

### HomeGem is a first generation finetune of Gemma 3n e4b IT, for use as a conversational LLM controlling your Home Assistant environment. Finetuning was performed on an A100 SXM4, and finetuned using the acon96/Home-Assistant-Requests dataset.

## Eval Results
```
Step 5: Displaying post-training statistics and evaluation loss...
2797.18 seconds used for training.
Peak reserved memory: 17.799 GB.
Peak memory for training: 8.42 GB.

--- Evaluation Loss Progression ---
Step 20: Eval Loss = 2.0582
Step 40: Eval Loss = 1.6810
Step 60: Eval Loss = 1.5477
Step 80: Eval Loss = 1.4737
Step 100: Eval Loss = 1.4113
Step 120: Eval Loss = 1.3982
Step 140: Eval Loss = 1.4340
Step 160: Eval Loss = 1.4325
Step 180: Eval Loss = 1.4424
Step 200: Eval Loss = 1.4442

--- Summary ---
Initial Eval Loss: 2.0582
Final Eval Loss:   1.4442
Improvement:       0.6140
---------------------------------
```

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)