Update README.md
Browse files
README.md
CHANGED
|
@@ -17,12 +17,17 @@ pipeline_tag: text-generation
|
|
| 17 |
This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3).
|
| 18 |
It has been trained using [TRL](https://github.com/huggingface/trl).
|
| 19 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
## Quick start
|
| 21 |
|
| 22 |
```python
|
| 23 |
from transformers import pipeline
|
| 24 |
|
| 25 |
-
question = "
|
| 26 |
generator = pipeline("text-generation", model="None", device="cuda")
|
| 27 |
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
|
| 28 |
print(output["generated_text"])
|
|
@@ -30,10 +35,7 @@ print(output["generated_text"])
|
|
| 30 |
|
| 31 |
## Training procedure
|
| 32 |
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
This model was trained with SFT.
|
| 37 |
|
| 38 |
### Framework versions
|
| 39 |
|
|
|
|
| 17 |
This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3).
|
| 18 |
It has been trained using [TRL](https://github.com/huggingface/trl).
|
| 19 |
|
| 20 |
+
Mistral-7B Instruct — LoRA (ICD-10 labels → codes)
|
| 21 |
+
|
| 22 |
+
This LoRA adapter fine-tunes mistralai/Mistral-7B-Instruct-v0.3 to map French ICD-10 diagnostic labels (synonyms) to their corresponding codes (dot-less, up to 5 chars).
|
| 23 |
+
|
| 24 |
+
|
| 25 |
## Quick start
|
| 26 |
|
| 27 |
```python
|
| 28 |
from transformers import pipeline
|
| 29 |
|
| 30 |
+
question = "Libellé: Antécédent bronchite chronique"
|
| 31 |
generator = pipeline("text-generation", model="None", device="cuda")
|
| 32 |
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
|
| 33 |
print(output["generated_text"])
|
|
|
|
| 35 |
|
| 36 |
## Training procedure
|
| 37 |
|
| 38 |
+
It was trained via supervised fine-tuning (QLoRA) on an instruction dataset built from (label, code) pairs (instruct_labels2codes) derived from a curated ICD-10 synonyms table created from the webscrapinng of aideaucodage.fr .
|
|
|
|
|
|
|
|
|
|
| 39 |
|
| 40 |
### Framework versions
|
| 41 |
|