WilliamHH commited on
Commit
45dc681
·
verified ·
1 Parent(s): aa40605

End of training

Browse files
Files changed (1) hide show
  1. README.md +8 -14
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M](https://huggingface.co/HuggingFaceTB/SmolLM-135M) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2.8719
20
 
21
  ## Model description
22
 
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 3e-05
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
@@ -47,18 +47,12 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 2.594 | 0.16 | 200 | 2.9858 |
51
- | 2.5675 | 0.32 | 400 | 2.9604 |
52
- | 2.5578 | 0.48 | 600 | 2.9417 |
53
- | 2.6641 | 0.64 | 800 | 2.9061 |
54
- | 2.6633 | 0.8 | 1000 | 2.8829 |
55
- | 2.6115 | 0.96 | 1200 | 2.8656 |
56
- | 2.4333 | 1.12 | 1400 | 2.8809 |
57
- | 2.3539 | 1.28 | 1600 | 2.8797 |
58
- | 2.3336 | 1.44 | 1800 | 2.8743 |
59
- | 2.334 | 1.6 | 2000 | 2.8731 |
60
- | 2.3502 | 1.76 | 2200 | 2.8723 |
61
- | 2.3205 | 1.92 | 2400 | 2.8719 |
62
 
63
 
64
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M](https://huggingface.co/HuggingFaceTB/SmolLM-135M) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 2.9966
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 5e-05
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 3.1852 | 0.32 | 200 | 3.1458 |
51
+ | 2.8767 | 0.64 | 400 | 3.0504 |
52
+ | 2.7815 | 0.96 | 600 | 3.0009 |
53
+ | 2.4577 | 1.28 | 800 | 3.0048 |
54
+ | 2.3987 | 1.6 | 1000 | 2.9972 |
55
+ | 2.3939 | 1.92 | 1200 | 2.9966 |
 
 
 
 
 
 
56
 
57
 
58
  ### Framework versions