TitleOS commited on
Commit
83c32d3
·
verified ·
1 Parent(s): e203593

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -6
README.md CHANGED
@@ -5,17 +5,43 @@ tags:
5
  - transformers
6
  - unsloth
7
  - gemma3n
8
- license: apache-2.0
9
  language:
10
  - en
 
 
11
  ---
12
 
13
- # Uploaded finetuned model
14
-
15
  - **Developed by:** TitleOS
16
- - **License:** apache-2.0
17
  - **Finetuned from model :** unsloth/gemma-3n-e4b-it-unsloth-bnb-4bit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
- This gemma3n model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
 
 
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
5
  - transformers
6
  - unsloth
7
  - gemma3n
8
+ license: mpl-2.0
9
  language:
10
  - en
11
+ datasets:
12
+ - acon96/Home-Assistant-Requests
13
  ---
14
 
15
+ # HomeGem4Bn
 
16
  - **Developed by:** TitleOS
17
+ - **License:** mpl-2.0
18
  - **Finetuned from model :** unsloth/gemma-3n-e4b-it-unsloth-bnb-4bit
19
+ HomeGem is a first generation finetune of Gemma 3n e4b IT, for use as a conversational LLM controlling your Home Assistant environment. Finetuning was performed on an A100 SXM4, and finetuned using the acon96/Home-Assistant-Requests dataset.
20
+
21
+ ## Eval Results
22
+ ```
23
+ Step 5: Displaying post-training statistics and evaluation loss...
24
+ 2797.18 seconds used for training.
25
+ Peak reserved memory: 17.799 GB.
26
+ Peak memory for training: 8.42 GB.
27
+
28
+ --- Evaluation Loss Progression ---
29
+ Step 20: Eval Loss = 2.0582
30
+ Step 40: Eval Loss = 1.6810
31
+ Step 60: Eval Loss = 1.5477
32
+ Step 80: Eval Loss = 1.4737
33
+ Step 100: Eval Loss = 1.4113
34
+ Step 120: Eval Loss = 1.3982
35
+ Step 140: Eval Loss = 1.4340
36
+ Step 160: Eval Loss = 1.4325
37
+ Step 180: Eval Loss = 1.4424
38
+ Step 200: Eval Loss = 1.4442
39
 
40
+ --- Summary ---
41
+ Initial Eval Loss: 2.0582
42
+ Final Eval Loss: 1.4442
43
+ Improvement: 0.6140
44
+ ---------------------------------
45
+ ```
46
 
47
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)