Commit
·
ffb1723
1
Parent(s):
155c7c3
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,7 +9,7 @@ license: mit
|
|
| 9 |
---
|
| 10 |
|
| 11 |
# Model Description
|
| 12 |
-
ClinicalMobileBERT is the result of training the [BioMobileBERT](https://huggingface.co/
|
| 13 |
|
| 14 |
# Initialisation
|
| 15 |
We initialise our model with the pre-trained checkpoints of the [BioMobileBERT](https://huggingface.co/google/nlpie/bio-mobilebert) model available on Huggingface.
|
|
|
|
| 9 |
---
|
| 10 |
|
| 11 |
# Model Description
|
| 12 |
+
ClinicalMobileBERT is the result of training the [BioMobileBERT](https://huggingface.co/nlpie/bio-mobilebert) model in a continual learning scenario for 3 epochs using a total batch size of 192 on the MIMIC-III notes dataset.
|
| 13 |
|
| 14 |
# Initialisation
|
| 15 |
We initialise our model with the pre-trained checkpoints of the [BioMobileBERT](https://huggingface.co/google/nlpie/bio-mobilebert) model available on Huggingface.
|