Eghbal commited on
Commit
6f6e409
·
verified ·
1 Parent(s): 055686f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -24,7 +24,7 @@ We are thrilled to introduce a specialised suite of **68 large language models (
24
  - **Time-Period Specific Models:** Separate models are pre-trained for each year from **2007 to 2023**, ensuring the utmost precision and historical relevance.
25
  - **RoBERTa Architecture:** The suite includes both a **base model** with **125 million parameters** and a **smaller variant** with **51 million parameters**.
26
  - **Two distinct pre-training durations:** We also introduce a series of models to explore the impact of futher pre-training.
27
- - **Accessibility:** The models are pre-trained using BF16, but are released in FP32 format to ensure they are accessible to a broader community, including those without high-end GPUs.
28
 
29
  Stay tuned for upcoming updates and new features for FinText. We expect to launch stages 2 and 3 within the next 9 months. 🎉
30
 
 
24
  - **Time-Period Specific Models:** Separate models are pre-trained for each year from **2007 to 2023**, ensuring the utmost precision and historical relevance.
25
  - **RoBERTa Architecture:** The suite includes both a **base model** with **125 million parameters** and a **smaller variant** with **51 million parameters**.
26
  - **Two distinct pre-training durations:** We also introduce a series of models to explore the impact of futher pre-training.
27
+ - **Accessibility:** The models are pre-trained using **BF16**, but are released in **FP32** format to ensure they are accessible to a broader community, including those without high-end GPUs.
28
 
29
  Stay tuned for upcoming updates and new features for FinText. We expect to launch stages 2 and 3 within the next 9 months. 🎉
30