Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -25,6 +25,9 @@ We are thrilled to introduce a specialised suite of **68 large language models (
|
|
| 25 |
- **RoBERTa Architecture:** The suite includes both a **base model** with **125 million parameters** and a **smaller variant** with **51 million parameters**.
|
| 26 |
- **Two distinct pre-training durations:** We also introduce a series of models to explore the impact of futher pre-training.
|
| 27 |
- **Accessibility:** The models are pre-trained using **BF16**, but are released in **FP32** format to ensure they are accessible to a broader community, including those without high-end GPUs.
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
Stay tuned for upcoming updates and new features for FinText. We expect to launch stages 2 and 3 within the next 9 months. 🎉
|
| 30 |
|
|
|
|
| 25 |
- **RoBERTa Architecture:** The suite includes both a **base model** with **125 million parameters** and a **smaller variant** with **51 million parameters**.
|
| 26 |
- **Two distinct pre-training durations:** We also introduce a series of models to explore the impact of futher pre-training.
|
| 27 |
- **Accessibility:** The models are pre-trained using **BF16**, but are released in **FP32** format to ensure they are accessible to a broader community, including those without high-end GPUs.
|
| 28 |
+
- **Sustainability:** The entire electricity used was fully traceable and sourced exclusively from renewable energy.
|
| 29 |
+
|
| 30 |
+
|
| 31 |
|
| 32 |
Stay tuned for upcoming updates and new features for FinText. We expect to launch stages 2 and 3 within the next 9 months. 🎉
|
| 33 |
|