Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -16,11 +16,15 @@ We value:
|
|
| 16 |
In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants). There are currently four model collections:
|
| 17 |
- RoLlama2: Romanian models based on Llama2
|
| 18 |
- RoMistral: Romanian models based on Mistral
|
| 19 |
-
- RoGemma: Romanian models based on Gemma
|
| 20 |
- RoLlama3: Romanian models based on Llama3
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
-
Furthermore, here you can find data used to train and evaluate LLMs in Romanian. Currently, there are
|
| 23 |
- SFT datasets: data used for supervised (instruction) finetuning
|
|
|
|
| 24 |
- Evaluation datasets: data used for evaluating LLM in Romanian
|
| 25 |
|
| 26 |
See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/2405.07703](https://arxiv.org/abs/2405.07703).
|
|
|
|
| 16 |
In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants). There are currently four model collections:
|
| 17 |
- RoLlama2: Romanian models based on Llama2
|
| 18 |
- RoMistral: Romanian models based on Mistral
|
|
|
|
| 19 |
- RoLlama3: Romanian models based on Llama3
|
| 20 |
+
- RoLlama3.1: Romanian models based on Llama3.1
|
| 21 |
+
- RoGemma: Romanian models based on Gemma
|
| 22 |
+
- RoGemma2: Romanian models based on Gemma2
|
| 23 |
+
|
| 24 |
|
| 25 |
+
Furthermore, here you can find data used to train and evaluate LLMs in Romanian. Currently, there are three data collections:
|
| 26 |
- SFT datasets: data used for supervised (instruction) finetuning
|
| 27 |
+
- Alignment datasets: data used mainly for Direct Preference Optimization (DPO)
|
| 28 |
- Evaluation datasets: data used for evaluating LLM in Romanian
|
| 29 |
|
| 30 |
See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/2405.07703](https://arxiv.org/abs/2405.07703).
|