Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,7 @@ We are thrilled to introduce a specialised suite of **68 large language models (
|
|
| 26 |
- **Time-Period Specific Models:** Separate models are pre-trained for each year from **2007 to 2023**, ensuring the utmost precision and historical relevance.
|
| 27 |
- **RoBERTa Architecture:** The suite includes both a **base model** with **125 million parameters** and a **smaller variant** with **51 million parameters**.
|
| 28 |
- **Two distinct pre-training durations:** We also introduce a series of models to explore the impact of futher pre-training.
|
|
|
|
| 29 |
|
| 30 |
Stay tuned for upcoming updates and new features for FinText. We expect to launch stages 2 and 3 within the next 9 months. 🎉
|
| 31 |
|
|
|
|
| 26 |
- **Time-Period Specific Models:** Separate models are pre-trained for each year from **2007 to 2023**, ensuring the utmost precision and historical relevance.
|
| 27 |
- **RoBERTa Architecture:** The suite includes both a **base model** with **125 million parameters** and a **smaller variant** with **51 million parameters**.
|
| 28 |
- **Two distinct pre-training durations:** We also introduce a series of models to explore the impact of futher pre-training.
|
| 29 |
+
- **Accessibility:** The models are pre-trained using BF16, but are released in FP32 format to ensure they are accessible to a broader community, including those without high-end GPUs.
|
| 30 |
|
| 31 |
Stay tuned for upcoming updates and new features for FinText. We expect to launch stages 2 and 3 within the next 9 months. 🎉
|
| 32 |
|