Training completed with emotion labels, simplified implementation code!
Browse files
README.md
CHANGED
|
@@ -14,48 +14,25 @@ model-index:
|
|
| 14 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 15 |
should probably proofread and complete it, then remove this comment. -->
|
| 16 |
|
| 17 |
-
#
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
### Limitations
|
| 38 |
-
- Limited to six basic emotions
|
| 39 |
-
- Best suited for English text
|
| 40 |
-
- May not perform well on very short texts or slang
|
| 41 |
-
- Not suitable for clinical or diagnostic purposes
|
| 42 |
-
|
| 43 |
-
## Training and Evaluation Data
|
| 44 |
-
|
| 45 |
-
### Dataset
|
| 46 |
-
The model was fine-tuned on the [DAIR-AI Emotion Dataset](https://huggingface.co/datasets/dair-ai/emotion), which contains:
|
| 47 |
-
- Training set: 16,000 examples
|
| 48 |
-
- Validation set: 2,000 examples
|
| 49 |
-
- Test set: 2,000 examples
|
| 50 |
-
|
| 51 |
-
### Data Distribution
|
| 52 |
-
The dataset includes text labeled with six emotion categories:
|
| 53 |
-
- Sadness
|
| 54 |
-
- Joy
|
| 55 |
-
- Love
|
| 56 |
-
- Anger
|
| 57 |
-
- Fear
|
| 58 |
-
- Surprise
|
| 59 |
|
| 60 |
## Training procedure
|
| 61 |
|
|
@@ -75,11 +52,11 @@ The following hyperparameters were used during training:
|
|
| 75 |
|
| 76 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Per Class |
|
| 77 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
|
| 78 |
-
| 0.
|
| 79 |
-
| 0.
|
| 80 |
-
| 0.
|
| 81 |
-
| 0.
|
| 82 |
-
| 0.
|
| 83 |
|
| 84 |
|
| 85 |
### Framework versions
|
|
|
|
| 14 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 15 |
should probably proofread and complete it, then remove this comment. -->
|
| 16 |
|
| 17 |
+
# roberta-emotion
|
| 18 |
+
|
| 19 |
+
This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
|
| 20 |
+
It achieves the following results on the evaluation set:
|
| 21 |
+
- Loss: 0.1336
|
| 22 |
+
- Accuracy: 0.941
|
| 23 |
+
- Per Class: {'sadness': 0.9636363636363636, 'joy': 0.96875, 'love': 0.8370786516853933, 'anger': 0.9454545454545454, 'fear': 0.9009433962264151, 'surprise': 0.8641975308641975}
|
| 24 |
+
|
| 25 |
+
## Model description
|
| 26 |
+
|
| 27 |
+
More information needed
|
| 28 |
+
|
| 29 |
+
## Intended uses & limitations
|
| 30 |
+
|
| 31 |
+
More information needed
|
| 32 |
+
|
| 33 |
+
## Training and evaluation data
|
| 34 |
+
|
| 35 |
+
More information needed
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
## Training procedure
|
| 38 |
|
|
|
|
| 52 |
|
| 53 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Per Class |
|
| 54 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
|
| 55 |
+
| 0.7921 | 1.0 | 500 | 0.2453 | 0.9205 | {'sadness': 0.9618181818181818, 'joy': 0.953125, 'love': 0.8202247191011236, 'anger': 0.8763636363636363, 'fear': 0.8254716981132075, 'surprise': 0.9753086419753086} |
|
| 56 |
+
| 0.2062 | 2.0 | 1000 | 0.1608 | 0.938 | {'sadness': 0.9563636363636364, 'joy': 0.9829545454545454, 'love': 0.7415730337078652, 'anger': 0.9345454545454546, 'fear': 0.9433962264150944, 'surprise': 0.8518518518518519} |
|
| 57 |
+
| 0.1342 | 3.0 | 1500 | 0.1418 | 0.9335 | {'sadness': 0.9581818181818181, 'joy': 0.9758522727272727, 'love': 0.7808988764044944, 'anger': 0.9127272727272727, 'fear': 0.9056603773584906, 'surprise': 0.8765432098765432} |
|
| 58 |
+
| 0.1001 | 4.0 | 2000 | 0.1336 | 0.941 | {'sadness': 0.9636363636363636, 'joy': 0.96875, 'love': 0.8370786516853933, 'anger': 0.9454545454545454, 'fear': 0.9009433962264151, 'surprise': 0.8641975308641975} |
|
| 59 |
+
| 0.0751 | 5.0 | 2500 | 0.1445 | 0.942 | {'sadness': 0.9763636363636363, 'joy': 0.9573863636363636, 'love': 0.8595505617977528, 'anger': 0.9418181818181818, 'fear': 0.910377358490566, 'surprise': 0.8395061728395061} |
|
| 60 |
|
| 61 |
|
| 62 |
### Framework versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 328504584
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5d0bd25f38ae9d46a4cf2886582270f3e924c65a91c1a7495b554947c2c43ae7
|
| 3 |
size 328504584
|
runs/Feb15_20-07-47_97bd1760a9c6/events.out.tfevents.1739650070.97bd1760a9c6.321.0
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1db011930557b0137d4a71c881e543a18d47d327bd5d4a387c51e67a903e86bf
|
| 3 |
+
size 8359
|
runs/Feb15_20-07-47_97bd1760a9c6/events.out.tfevents.1739650820.97bd1760a9c6.321.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fcf920efe4b952281001e1defbeed4b54b1f242cb122a84ed6eec216be54998
|
| 3 |
+
size 411
|