Update README.md
Browse files
README.md
CHANGED
|
@@ -1,15 +1,14 @@
|
|
| 1 |
|
| 2 |
-
Training Metrics
|
| 3 |
-
Dataset Information
|
| 4 |
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
|
|
|
| 8 |
|
| 9 |
-
Training Results
|
| 10 |
-
Epoch 3 Performance
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
Perplexity: 14.71
|
| 14 |
|
| 15 |

|
|
|
|
| 1 |
|
| 2 |
+
# Training Metrics
|
|
|
|
| 3 |
|
| 4 |
+
## Dataset Information
|
| 5 |
+
- Training data per epoch: 1 GB
|
| 6 |
+
- Total tokens trained: 48,261,120
|
| 7 |
+
- No sythetic data
|
| 8 |
|
| 9 |
+
## Training Results
|
| 10 |
+
### Epoch 3 Performance
|
| 11 |
+
- Average Loss: 2.6883
|
| 12 |
+
- Perplexity: 14.71
|
|
|
|
| 13 |
|
| 14 |

|