mananshah296 commited on
Commit
4b146ff
·
verified ·
1 Parent(s): eb321da

Training completed with emotion labels, simplified implementation code!

Browse files
README.md CHANGED
@@ -14,48 +14,25 @@ model-index:
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
17
- # RoBERTa Emotion Classifier
18
- This model is a fine-tuned version of `distilroberta-base` for emotion classification, trained on the [DAIR-AI Emotion Dataset](https://huggingface.co/datasets/dair-ai/emotion).
19
-
20
- ## Model Description
21
- The model is designed to classify text into six different emotions: sadness, joy, love, anger, fear, and surprise. It uses a DistilRoBERTa architecture fine-tuned on emotional text data to provide accurate emotion predictions.
22
-
23
- ### Performance
24
- The model achieves the following results on the evaluation set:
25
- - Loss: 0.1517
26
- - Accuracy: 94.05%
27
-
28
- ## Intended Uses & Limitations
29
-
30
- ### Intended Uses
31
- - Emotion analysis in text
32
- - Sentiment classification
33
- - Social media content analysis
34
- - Customer feedback emotion detection
35
- - Conversational AI emotion understanding
36
-
37
- ### Limitations
38
- - Limited to six basic emotions
39
- - Best suited for English text
40
- - May not perform well on very short texts or slang
41
- - Not suitable for clinical or diagnostic purposes
42
-
43
- ## Training and Evaluation Data
44
-
45
- ### Dataset
46
- The model was fine-tuned on the [DAIR-AI Emotion Dataset](https://huggingface.co/datasets/dair-ai/emotion), which contains:
47
- - Training set: 16,000 examples
48
- - Validation set: 2,000 examples
49
- - Test set: 2,000 examples
50
-
51
- ### Data Distribution
52
- The dataset includes text labeled with six emotion categories:
53
- - Sadness
54
- - Joy
55
- - Love
56
- - Anger
57
- - Fear
58
- - Surprise
59
 
60
  ## Training procedure
61
 
@@ -75,11 +52,11 @@ The following hyperparameters were used during training:
75
 
76
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Per Class |
77
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
78
- | 0.7509 | 1.0 | 500 | 0.2261 | 0.922 | {'sadness': 0.9527272727272728, 'joy': 0.9176136363636364, 'love': 0.9550561797752809, 'anger': 0.8581818181818182, 'fear': 0.8962264150943396, 'surprise': 0.9629629629629629} |
79
- | 0.1966 | 2.0 | 1000 | 0.1587 | 0.9315 | {'sadness': 0.9545454545454546, 'joy': 0.984375, 'love': 0.7415730337078652, 'anger': 0.92, 'fear': 0.9009433962264151, 'surprise': 0.8518518518518519} |
80
- | 0.1254 | 3.0 | 1500 | 0.1371 | 0.9415 | {'sadness': 0.9672727272727273, 'joy': 0.9630681818181818, 'love': 0.8539325842696629, 'anger': 0.9527272727272728, 'fear': 0.8632075471698113, 'surprise': 0.9382716049382716} |
81
- | 0.0995 | 4.0 | 2000 | 0.1316 | 0.9425 | {'sadness': 0.98, 'joy': 0.9644886363636364, 'love': 0.8370786516853933, 'anger': 0.9454545454545454, 'fear': 0.8820754716981132, 'surprise': 0.8765432098765432} |
82
- | 0.073 | 5.0 | 2500 | 0.1444 | 0.943 | {'sadness': 0.9745454545454545, 'joy': 0.953125, 'love': 0.8820224719101124, 'anger': 0.9563636363636364, 'fear': 0.8915094339622641, 'surprise': 0.8641975308641975} |
83
 
84
 
85
  ### Framework versions
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
  should probably proofread and complete it, then remove this comment. -->
16
 
17
+ # roberta-emotion
18
+
19
+ This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.1336
22
+ - Accuracy: 0.941
23
+ - Per Class: {'sadness': 0.9636363636363636, 'joy': 0.96875, 'love': 0.8370786516853933, 'anger': 0.9454545454545454, 'fear': 0.9009433962264151, 'surprise': 0.8641975308641975}
24
+
25
+ ## Model description
26
+
27
+ More information needed
28
+
29
+ ## Intended uses & limitations
30
+
31
+ More information needed
32
+
33
+ ## Training and evaluation data
34
+
35
+ More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
 
37
  ## Training procedure
38
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Per Class |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
55
+ | 0.7921 | 1.0 | 500 | 0.2453 | 0.9205 | {'sadness': 0.9618181818181818, 'joy': 0.953125, 'love': 0.8202247191011236, 'anger': 0.8763636363636363, 'fear': 0.8254716981132075, 'surprise': 0.9753086419753086} |
56
+ | 0.2062 | 2.0 | 1000 | 0.1608 | 0.938 | {'sadness': 0.9563636363636364, 'joy': 0.9829545454545454, 'love': 0.7415730337078652, 'anger': 0.9345454545454546, 'fear': 0.9433962264150944, 'surprise': 0.8518518518518519} |
57
+ | 0.1342 | 3.0 | 1500 | 0.1418 | 0.9335 | {'sadness': 0.9581818181818181, 'joy': 0.9758522727272727, 'love': 0.7808988764044944, 'anger': 0.9127272727272727, 'fear': 0.9056603773584906, 'surprise': 0.8765432098765432} |
58
+ | 0.1001 | 4.0 | 2000 | 0.1336 | 0.941 | {'sadness': 0.9636363636363636, 'joy': 0.96875, 'love': 0.8370786516853933, 'anger': 0.9454545454545454, 'fear': 0.9009433962264151, 'surprise': 0.8641975308641975} |
59
+ | 0.0751 | 5.0 | 2500 | 0.1445 | 0.942 | {'sadness': 0.9763636363636363, 'joy': 0.9573863636363636, 'love': 0.8595505617977528, 'anger': 0.9418181818181818, 'fear': 0.910377358490566, 'surprise': 0.8395061728395061} |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c4ee81b6026e3591f21d8700f4776a19518544c7bcf63d34d00031fee816b72d
3
  size 328504584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d0bd25f38ae9d46a4cf2886582270f3e924c65a91c1a7495b554947c2c43ae7
3
  size 328504584
runs/Feb15_20-07-47_97bd1760a9c6/events.out.tfevents.1739650070.97bd1760a9c6.321.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a45689df81871005a3efa3bae62331802ec7e2c0d846272714226a1b2f70fc5
3
- size 7682
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1db011930557b0137d4a71c881e543a18d47d327bd5d4a387c51e67a903e86bf
3
+ size 8359
runs/Feb15_20-07-47_97bd1760a9c6/events.out.tfevents.1739650820.97bd1760a9c6.321.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fcf920efe4b952281001e1defbeed4b54b1f242cb122a84ed6eec216be54998
3
+ size 411