Hugging Face's logo

ninagroot
/
Baby-Llama-58M-RUN1

Text Generation
Transformers
Safetensors
llama
Generated from Trainer
text-generation-inference
Model card Files
xet
Community
ninagroot commited on
Commit
d3c9b6e
·
verified ·
1 Parent(s): 4070047

ninagroot/babyllamatest

Browse files
Files changed (3) hide show
  1. README.md +21 -21
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 3.9569
17
 
18
  ## Model description
19
 
@@ -46,26 +46,26 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 207.4139 | 1.0 | 69 | 168.7495 |
50
- | 140.1234 | 2.0 | 138 | 105.7544 |
51
- | 65.5354 | 3.0 | 207 | 45.8237 |
52
- | 25.9459 | 4.0 | 276 | 19.2743 |
53
- | 14.1729 | 5.0 | 345 | 11.7973 |
54
- | 9.9299 | 6.0 | 414 | 8.2180 |
55
- | 6.8093 | 7.0 | 483 | 6.8497 |
56
- | 6.1741 | 8.0 | 552 | 6.4197 |
57
- | 5.4877 | 9.0 | 621 | 5.6851 |
58
- | 4.7765 | 10.0 | 690 | 5.4365 |
59
- | 4.6208 | 11.0 | 759 | 5.0201 |
60
- | 4.146 | 12.0 | 828 | 4.8232 |
61
- | 3.9427 | 13.0 | 897 | 4.4196 |
62
- | 3.746 | 14.0 | 966 | 4.2562 |
63
- | 3.6516 | 15.0 | 1035 | 4.1581 |
64
- | 3.4029 | 16.0 | 1104 | 4.0782 |
65
- | 3.3875 | 17.0 | 1173 | 4.0212 |
66
- | 3.1863 | 18.0 | 1242 | 3.9801 |
67
- | 3.2367 | 19.0 | 1311 | 3.9602 |
68
- | 3.2766 | 20.0 | 1380 | 3.9569 |
69
 
70
 
71
  ### Framework versions
 
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 3.9790
17
 
18
  ## Model description
19
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 205.6138 | 1.0 | 69 | 165.0209 |
50
+ | 140.5155 | 2.0 | 138 | 108.3043 |
51
+ | 71.1999 | 3.0 | 207 | 48.5052 |
52
+ | 26.2745 | 4.0 | 276 | 20.7425 |
53
+ | 13.2665 | 5.0 | 345 | 12.1278 |
54
+ | 9.6075 | 6.0 | 414 | 8.5203 |
55
+ | 6.7498 | 7.0 | 483 | 6.8251 |
56
+ | 6.1128 | 8.0 | 552 | 6.3816 |
57
+ | 5.5661 | 9.0 | 621 | 5.6632 |
58
+ | 4.8771 | 10.0 | 690 | 5.3599 |
59
+ | 4.6769 | 11.0 | 759 | 5.0607 |
60
+ | 4.2186 | 12.0 | 828 | 4.7932 |
61
+ | 3.9824 | 13.0 | 897 | 4.4486 |
62
+ | 3.8089 | 14.0 | 966 | 4.2846 |
63
+ | 3.6713 | 15.0 | 1035 | 4.1736 |
64
+ | 3.4087 | 16.0 | 1104 | 4.1207 |
65
+ | 3.4155 | 17.0 | 1173 | 4.0485 |
66
+ | 3.2099 | 18.0 | 1242 | 4.0001 |
67
+ | 3.2476 | 19.0 | 1311 | 3.9819 |
68
+ | 3.2992 | 20.0 | 1380 | 3.9790 |
69
 
70
 
71
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:30f1bd31251eacb162c62b163981446fb3b2d4eaaa6053668d1b918b7b5fa5a0
3
  size 185517896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e1af789ab67b927e9857138eaf00c67a67ee0caf68b7ce064d21d7bda7371e9
3
  size 185517896
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e1383968255addb16ba6b2f8442175b7cab5a71cfa956f933a3f957418af4f0
3
  size 4792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:583ec0d9fd1108d00756e1c3b69ddbec684f2f03713c12642e1c41db6c04a6f0
3
  size 4792