|
|
--- |
|
|
license: apache-2.0 |
|
|
tags: |
|
|
- legal |
|
|
- french |
|
|
- mistral |
|
|
- fine-tuned |
|
|
language: |
|
|
- fr |
|
|
metrics: |
|
|
- rouge |
|
|
- bleu |
|
|
base_model: |
|
|
- mistralai/Mistral-7B-Instruct-v0.2 |
|
|
pipeline_tag: question-answering |
|
|
--- |
|
|
|
|
|
# AIAJ: Fine-Tuned Mistral-7B for French Legal Tasks |
|
|
|
|
|
This model is a fine-tuned version of `mistralai/Mistral-7B-Instruct-v0.3` for French legal tasks, including legal Q&A, template generation, and personalized document creation. It was fine-tuned on a dataset of 541 examples using LoRA (r=4) on Kaggle. |
|
|
|
|
|
## Training Details |
|
|
- Dataset: 541 examples (reduced to 150 for training) |
|
|
- Epochs: 2 |
|
|
- Training Loss: Decreased to 2.0857 |
|
|
- Validation Loss: Decreased to 1.83909 |
|
|
- Completion Date: 2025-05-15 09:21:25 CEST |
|
|
|
|
|
For more details, contact the project team. |