Hugging Face's logo

ninagroot
/
Baby-Llama-58M-RUN1

Text Generation
Transformers
Safetensors
llama
Generated from Trainer
text-generation-inference
Model card Files
xet
 Community
ninagroot commited on
Commit
fe81339
·
verified ·
1 Parent(s): d068134

ninagroot/babyllamatest

Browse files
Files changed (3) hide show
  1. README.md +21 -21
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 3.9610
17
 
18
  ## Model description
19
 
@@ -46,26 +46,26 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 206.943 | 1.0 | 69 | 166.3778 |
50
- | 138.4555 | 2.0 | 138 | 104.0753 |
51
- | 66.034 | 3.0 | 207 | 43.8374 |
52
- | 27.1436 | 4.0 | 276 | 20.7827 |
53
- | 13.8693 | 5.0 | 345 | 11.6380 |
54
- | 9.7743 | 6.0 | 414 | 8.3680 |
55
- | 6.9283 | 7.0 | 483 | 7.0591 |
56
- | 6.0877 | 8.0 | 552 | 6.2705 |
57
- | 5.4184 | 9.0 | 621 | 5.6714 |
58
- | 4.759 | 10.0 | 690 | 5.4118 |
59
- | 4.7849 | 11.0 | 759 | 4.9545 |
60
- | 4.1408 | 12.0 | 828 | 4.7373 |
61
- | 3.9824 | 13.0 | 897 | 4.4636 |
62
- | 3.7767 | 14.0 | 966 | 4.2870 |
63
- | 3.6403 | 15.0 | 1035 | 4.1945 |
64
- | 3.4008 | 16.0 | 1104 | 4.0799 |
65
- | 3.4039 | 17.0 | 1173 | 4.0271 |
66
- | 3.1972 | 18.0 | 1242 | 3.9771 |
67
- | 3.2312 | 19.0 | 1311 | 3.9653 |
68
- | 3.2737 | 20.0 | 1380 | 3.9610 |
69
 
70
 
71
  ### Framework versions
 
13
 
14
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 3.9707
17
 
18
  ## Model description
19
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 205.7347 | 1.0 | 69 | 164.9866 |
50
+ | 140.7988 | 2.0 | 138 | 105.9197 |
51
+ | 69.569 | 3.0 | 207 | 46.6930 |
52
+ | 28.052 | 4.0 | 276 | 19.8943 |
53
+ | 14.7501 | 5.0 | 345 | 11.8347 |
54
+ | 10.0078 | 6.0 | 414 | 8.8358 |
55
+ | 6.8621 | 7.0 | 483 | 6.8726 |
56
+ | 6.2461 | 8.0 | 552 | 6.4684 |
57
+ | 5.4379 | 9.0 | 621 | 5.6002 |
58
+ | 4.8584 | 10.0 | 690 | 5.3592 |
59
+ | 4.652 | 11.0 | 759 | 5.0464 |
60
+ | 4.2405 | 12.0 | 828 | 4.6742 |
61
+ | 3.9809 | 13.0 | 897 | 4.3925 |
62
+ | 3.7987 | 14.0 | 966 | 4.2740 |
63
+ | 3.6593 | 15.0 | 1035 | 4.1871 |
64
+ | 3.4527 | 16.0 | 1104 | 4.1033 |
65
+ | 3.4028 | 17.0 | 1173 | 4.0354 |
66
+ | 3.2057 | 18.0 | 1242 | 3.9949 |
67
+ | 3.2595 | 19.0 | 1311 | 3.9728 |
68
+ | 3.2917 | 20.0 | 1380 | 3.9707 |
69
 
70
 
71
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01eb3ea6123ab73ab833a043e5bbd18b75537f98fbf3b8199e01af9c7ba5b5d9
3
  size 185517896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e635cde993d1b74d9570f588cc5fb277b168d39bbca59069c890601007f494c
3
  size 185517896
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3db52b5e60d07faf1e8ade2c260e9b62dbf50e2875c44732e551e5a9fe8c58ac
3
  size 4792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e2f5447f468a9cd43798831fadb6635e45910c2eb3f636c4e6469fef24b0e91
3
  size 4792