Update README.md
Browse files
README.md
CHANGED
|
@@ -27,7 +27,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 27 |
|
| 28 |

|
| 29 |
|
| 30 |
-
Mistral_classification_head_qlora has a new transformer head attached to it for sequence classification task and then resulting model has been finetuned on [dair-ai/emotion](https://huggingface.co/datasets/dair-ai/emotion)
|
| 31 |
dataset using QloRA. The model has been trained for 1 epoch on 1x A40 GPU. The evaluation loss for the **emotion-head-3** attached to it was **1.313**. The base model used was
|
| 32 |
|
| 33 |
* **[mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)**
|
|
|
|
| 27 |
|
| 28 |

|
| 29 |
|
| 30 |
+
**Mistral_classification_head_qlora** has a new transformer head attached to it for sequence classification task and then resulting model has been finetuned on [dair-ai/emotion](https://huggingface.co/datasets/dair-ai/emotion)
|
| 31 |
dataset using QloRA. The model has been trained for 1 epoch on 1x A40 GPU. The evaluation loss for the **emotion-head-3** attached to it was **1.313**. The base model used was
|
| 32 |
|
| 33 |
* **[mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)**
|