Update README.md
Browse files
README.md
CHANGED
|
@@ -32,6 +32,7 @@ K2 is a fully transparent large language model on par with Llama 2 - 70B.
|
|
| 32 |
| s2orc | 107.9B | 1x | 107.9B | 8.3% |
|
| 33 |
| redpajama.wikipedia | 22.1B | 6x | 132.6B | 10.2% |
|
| 34 |
| refinedweb | 612.3B | 1x | 612.3B | 47.1% |
|
|
|
|
| 35 |
|
| 36 |
## First 10 Checkpoints
|
| 37 |
| Checkpoints | |
|
|
|
|
| 32 |
| s2orc | 107.9B | 1x | 107.9B | 8.3% |
|
| 33 |
| redpajama.wikipedia | 22.1B | 6x | 132.6B | 10.2% |
|
| 34 |
| refinedweb | 612.3B | 1x | 612.3B | 47.1% |
|
| 35 |
+
| Totals | - | - | 1.3T | 100% |
|
| 36 |
|
| 37 |
## First 10 Checkpoints
|
| 38 |
| Checkpoints | |
|