Update README.md
Browse files
README.md
CHANGED
|
@@ -17,4 +17,6 @@ Training for one full epoch, with a 256 batch size, maximally 768 sequence lengt
|
|
| 17 |
|
| 18 |
This model will be further pre-trained on 5 million cardiology records from the UMCU.
|
| 19 |
|
| 20 |
-
The perplexity was around 5 on the validation set.
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
This model will be further pre-trained on 5 million cardiology records from the UMCU.
|
| 19 |
|
| 20 |
+
The perplexity was around 5 on the validation set.
|
| 21 |
+
|
| 22 |
+
Note: this is not instruction tuned, and does not generate an EOS token.
|