Update README.md
Browse files
README.md
CHANGED
|
@@ -34,7 +34,7 @@ This model is a Dutch chat model, originally developed from Mistral 7B v0.3 Inst
|
|
| 34 |
## Intended uses & limitations
|
| 35 |
|
| 36 |
This model could still generate wrong, misleading, and potentially even offensive content. Use at your own risk.
|
| 37 |
-
Use with Mistral's chat template (can be found in the tokenizer)
|
| 38 |
|
| 39 |
## Training procedure
|
| 40 |
|
|
@@ -43,7 +43,7 @@ This model was trained with QLoRa in bfloat16 with flash attention 2 on oen A100
|
|
| 43 |
|
| 44 |
## Evaluation results
|
| 45 |
|
| 46 |
-
The model was evaluated using [scandeval](https://scandeval.com/dutch-nlg/). There are improvements in 4/7 benchmarks compared to the Mistral-7B-v0.3-Instruct model.
|
| 47 |
|
| 48 |
| Model| conll_nl | dutch_social | scala_nl | squad_nl | wiki_lingua_nl | mmlu_nl | hellaswag_nl |
|
| 49 |
|:-------------:|:-----:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:
|
|
@@ -77,4 +77,5 @@ The following hyperparameters were used during training:
|
|
| 77 |
|
| 78 |
## Model Developer
|
| 79 |
|
| 80 |
-
|
|
|
|
|
|
| 34 |
## Intended uses & limitations
|
| 35 |
|
| 36 |
This model could still generate wrong, misleading, and potentially even offensive content. Use at your own risk.
|
| 37 |
+
Use with Mistral's chat template (can be found in the tokenizer).
|
| 38 |
|
| 39 |
## Training procedure
|
| 40 |
|
|
|
|
| 43 |
|
| 44 |
## Evaluation results
|
| 45 |
|
| 46 |
+
The model was evaluated using [scandeval](https://scandeval.com/dutch-nlg/). There are improvements in 4/7 benchmarks compared to the Mistral-7B-v0.3-Instruct model it was based on.
|
| 47 |
|
| 48 |
| Model| conll_nl | dutch_social | scala_nl | squad_nl | wiki_lingua_nl | mmlu_nl | hellaswag_nl |
|
| 49 |
|:-------------:|:-----:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:
|
|
|
|
| 77 |
|
| 78 |
## Model Developer
|
| 79 |
|
| 80 |
+
The Mistral-7B-v0.3-Instruct model this model is based on is created by [Mistral AI](https://huggingface.co/mistralai).
|
| 81 |
+
The finetuning was done by [Julien Van den Avenne](https://huggingface.co/vandeju)
|