Hugging Face's logo

ninagroot
/
Baby-Llama-58M-RUN1

Text Generation
Transformers
Safetensors
llama
Generated from Trainer
text-generation-inference
Model card Files
xet
Community
ninagroot commited on
Commit
e36b736
·
verified ·
1 Parent(s): d3c9b6e

ninagroot/babyllamatest

Browse files
Files changed (3) hide show
  1. README.md +21 -21
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 3.9790
17
 
18
  ## Model description
19
 
@@ -46,26 +46,26 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 205.6138 | 1.0 | 69 | 165.0209 |
50
- | 140.5155 | 2.0 | 138 | 108.3043 |
51
- | 71.1999 | 3.0 | 207 | 48.5052 |
52
- | 26.2745 | 4.0 | 276 | 20.7425 |
53
- | 13.2665 | 5.0 | 345 | 12.1278 |
54
- | 9.6075 | 6.0 | 414 | 8.5203 |
55
- | 6.7498 | 7.0 | 483 | 6.8251 |
56
- | 6.1128 | 8.0 | 552 | 6.3816 |
57
- | 5.5661 | 9.0 | 621 | 5.6632 |
58
- | 4.8771 | 10.0 | 690 | 5.3599 |
59
- | 4.6769 | 11.0 | 759 | 5.0607 |
60
- | 4.2186 | 12.0 | 828 | 4.7932 |
61
- | 3.9824 | 13.0 | 897 | 4.4486 |
62
- | 3.8089 | 14.0 | 966 | 4.2846 |
63
- | 3.6713 | 15.0 | 1035 | 4.1736 |
64
- | 3.4087 | 16.0 | 1104 | 4.1207 |
65
- | 3.4155 | 17.0 | 1173 | 4.0485 |
66
- | 3.2099 | 18.0 | 1242 | 4.0001 |
67
- | 3.2476 | 19.0 | 1311 | 3.9819 |
68
- | 3.2992 | 20.0 | 1380 | 3.9790 |
69
 
70
 
71
  ### Framework versions
 
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 3.9805
17
 
18
  ## Model description
19
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 208.1439 | 1.0 | 69 | 168.7479 |
50
+ | 137.7666 | 2.0 | 138 | 104.4204 |
51
+ | 64.4054 | 3.0 | 207 | 42.3502 |
52
+ | 26.5661 | 4.0 | 276 | 19.2662 |
53
+ | 14.7544 | 5.0 | 345 | 12.7249 |
54
+ | 10.2813 | 6.0 | 414 | 8.5354 |
55
+ | 6.9142 | 7.0 | 483 | 7.3827 |
56
+ | 6.1554 | 8.0 | 552 | 6.4836 |
57
+ | 5.3557 | 9.0 | 621 | 5.5994 |
58
+ | 4.8551 | 10.0 | 690 | 5.4054 |
59
+ | 4.7462 | 11.0 | 759 | 4.9582 |
60
+ | 4.1657 | 12.0 | 828 | 4.7667 |
61
+ | 4.0338 | 13.0 | 897 | 4.4520 |
62
+ | 3.8436 | 14.0 | 966 | 4.2957 |
63
+ | 3.6859 | 15.0 | 1035 | 4.2060 |
64
+ | 3.4503 | 16.0 | 1104 | 4.0957 |
65
+ | 3.4381 | 17.0 | 1173 | 4.0400 |
66
+ | 3.2315 | 18.0 | 1242 | 4.0068 |
67
+ | 3.2559 | 19.0 | 1311 | 3.9848 |
68
+ | 3.3044 | 20.0 | 1380 | 3.9805 |
69
 
70
 
71
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e1af789ab67b927e9857138eaf00c67a67ee0caf68b7ce064d21d7bda7371e9
3
  size 185517896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9925d491ca799897f70b48245759259ad5d64b36d4b976076a474865f3e75683
3
  size 185517896
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:583ec0d9fd1108d00756e1c3b69ddbec684f2f03713c12642e1c41db6c04a6f0
3
  size 4792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d72472d90ccb6353e373291e39e33b128c9244c2d501fc745a44c17b455cf604
3
  size 4792