Hugging Face's logo

LLM360
/
K2

Text Generation
Transformers
Safetensors
English
llama
nlp
llm
text-generation-inference
Model card Files
xet
Community
5
victormiller commited on
Commit
fe01884
·
verified ·
1 Parent(s): 3420c8a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -2
README.md CHANGED
@@ -16,8 +16,23 @@ K2 is a fully transparent large language model on par with Llama 2 - 70B.
16
  <center><img src="eval_table_temp.png" alt="eval table"/></center>
17
 
18
  ## Datasets and Mix
19
- [insert about the data mix]
20
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  ## First 10 Checkpoints
23
  | Checkpoints | |
 
16
  <center><img src="eval_table_temp.png" alt="eval table"/></center>
17
 
18
  ## Datasets and Mix
19
+ | Dataset | Starting Tokens | Multiplier | Total Tokens |Percent of Total |
20
+ | ----------- | ----------- | ----------- | ----------- | ----------- |
21
+ | dm-math | 4.33 | 3x | 13B | 1% |
22
+ | Checkpoint 359[link] | Checkpoint 354[link] | Checkpoint 355[link] | Checkpoint 355[link] |
23
+ | Checkpoint 358[link] | Checkpoint 353[link] | Checkpoint 355[link] | Checkpoint 355[link] |
24
+ | Checkpoint 357[link] | Checkpoint 352[link] | Checkpoint 355[link] | Checkpoint 355[link] |
25
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
26
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
27
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
28
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
29
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
30
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
31
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
32
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
33
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
34
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
35
+ | Checkpoint 356[link] | Checkpoint 351[link] | Checkpoint 355[link] | Checkpoint 355[link] |
36
 
37
  ## First 10 Checkpoints
38
  | Checkpoints | |