Update README.md

README.md

@@ -25,6 +25,12 @@ This repo uses `trust_remote_code=True` because it ships a custom `modeling_*.py
 
 (In French only, we plan 20 languages as well as scientific and mathematical knowledge for BinaryLLM1)
 
+- 10 millions params
+- 2 billions training tokens
+- 40k steps
+- 1e-4 learning rate
+- Fp32 weight, FSDP training on 8 NVIDIA V100
+
 ## Load (Python)
 
 ```python