Update README.md

README.md

@@ -9,4 +9,10 @@ base_model:
 tags:
 - medical
 - cardiology
----
+---
+
+Llama-3.2-1B-Instruct, with domain adapted pretraining (DAPT), also called Continuous Pre-training (CPT) on a Dutch medical corpus.
+
+Training for one full epoch, with a 256 batch size, maximally 768 sequence length and a linear-cosine schedule (details follow..).
+
+This model will be further pre-trained on 5 million cardiology records from the UMCU.