ccore commited on
Commit
65e353a
·
1 Parent(s): 15b4045

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -44
README.md CHANGED
@@ -11,48 +11,6 @@ model-index:
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
  should probably proofread and complete it, then remove this comment. -->
14
- tinyllama base 55k steps
15
- # core61
16
 
17
- This model is a fine-tuned version of [core6/](https://huggingface.co/core6/) on an unknown dataset.
18
- It achieves the following results on the evaluation set:
19
- - Loss: 1.6814
20
- - Accuracy: 0.6489
21
-
22
- ## Model description
23
-
24
- More information needed
25
-
26
- ## Intended uses & limitations
27
-
28
- More information needed
29
-
30
- ## Training and evaluation data
31
-
32
- More information needed
33
-
34
- ## Training procedure
35
-
36
- ### Training hyperparameters
37
-
38
- The following hyperparameters were used during training:
39
- - learning_rate: 0.001
40
- - train_batch_size: 8
41
- - eval_batch_size: 8
42
- - seed: 42
43
- - gradient_accumulation_steps: 8
44
- - total_train_batch_size: 64
45
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
- - lr_scheduler_type: linear
47
- - num_epochs: 1.0
48
-
49
- ### Training results
50
-
51
-
52
-
53
- ### Framework versions
54
-
55
- - Transformers 4.34.0.dev0
56
- - Pytorch 2.0.1+cu117
57
- - Datasets 2.14.5
58
- - Tokenizers 0.13.3
 
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
  should probably proofread and complete it, then remove this comment. -->
14
+ tinyllama base 55k steps test
15
+ test was private, i release :D
16