eevvgg commited on
Commit
0e9f5f1
·
1 Parent(s): 778bfc8

up readme roberta

Browse files
Files changed (1) hide show
  1. README.md +14 -14
README.md CHANGED
@@ -37,7 +37,7 @@ model-index:
37
 
38
  <!-- Provide a quick summary of what the model is/does. -->
39
 
40
- This model is a fine-tuned version of sentiment classification model to predict 3 categories of stance (negative, positive, neutral) towards some entity mentioned in the text.
41
  Fine-tuned on a larger and more balanced data sample compared with the previous version [eevvgg/BEtMan-Tw](https://huggingface.co/eevvgg/BEtMan-Tw).
42
 
43
 
@@ -45,7 +45,7 @@ Fine-tuned on a larger and more balanced data sample compared with the previous
45
 
46
  - **Model type:** RoBERTa for stance classification
47
  - **Language(s) (NLP):** English social media data from Twitter and Reddit
48
- - **Finetuned from model:** [j-hartmann/sentiment-roberta-large-english-3-classes](https://huggingface.co/j-hartmann/sentiment-roberta-large-english-3-classes)
49
 
50
 
51
  ## Uses
@@ -63,7 +63,7 @@ result = cls_task(sequence)
63
 
64
  ```
65
 
66
- Sentiment classification in multilingual data. Fine-tuned on a balanced corpus of size 8.4k, partially semi-annotated.
67
  Model suited for classification of stance in short text.
68
  *Suitable for fine-tuning on hate/offensive language detection.
69
 
@@ -84,7 +84,7 @@ Normalization of user mentions and hyperlinks to "user" and "url" tokens, respec
84
  ### Training Hyperparameters
85
 
86
  - trained for 2 epochs, mini-batch size of 8.
87
- - loss: 0.574
88
  - learning_rate: 4e-5; weight_decay: 1e-2
89
 
90
  ## Evaluation
@@ -93,21 +93,21 @@ Normalization of user mentions and hyperlinks to "user" and "url" tokens, respec
93
 
94
  - evaluation on 15% of data.
95
 
96
- - accuracy: 91.2
97
  - macro avg:
98
- - f1: 91.4
99
- - precision: 91.4
100
- - recall: 91.5
101
  - weighted avg:
102
- - f1: 91.2
103
- - precision: 91.3
104
- - recall: 91.2
105
 
106
  precision recall f1-score support
107
 
108
- neutral 0.930 0.868 0.898 471
109
- positive 0.933 0.946 0.940 355
110
- negative 0.878 0.931 0.904 433
111
 
112
 
113
 
 
37
 
38
  <!-- Provide a quick summary of what the model is/does. -->
39
 
40
+ This model is a fine-tuned version of **roberta-base** model to predict 3 categories of stance (negative, positive, neutral) towards some entity mentioned in the text.
41
  Fine-tuned on a larger and more balanced data sample compared with the previous version [eevvgg/BEtMan-Tw](https://huggingface.co/eevvgg/BEtMan-Tw).
42
 
43
 
 
45
 
46
  - **Model type:** RoBERTa for stance classification
47
  - **Language(s) (NLP):** English social media data from Twitter and Reddit
48
+ - **Finetuned from model:** [roberta-base](roberta-base)
49
 
50
 
51
  ## Uses
 
63
 
64
  ```
65
 
66
+ Sentiment classification in multilingual data. Fine-tuned on a balanced corpus of size 6.2k, partially semi-annotated.
67
  Model suited for classification of stance in short text.
68
  *Suitable for fine-tuning on hate/offensive language detection.
69
 
 
84
  ### Training Hyperparameters
85
 
86
  - trained for 2 epochs, mini-batch size of 8.
87
+ - loss: 0.556
88
  - learning_rate: 4e-5; weight_decay: 1e-2
89
 
90
  ## Evaluation
 
93
 
94
  - evaluation on 15% of data.
95
 
96
+ - accuracy: 0.812
97
  - macro avg:
98
+ - f1: 0.816
99
+ - precision: 0.814
100
+ - recall: 0.818
101
  - weighted avg:
102
+ - f1: 0.812
103
+ - precision: 0.814
104
+ - recall: 0.812
105
 
106
  precision recall f1-score support
107
 
108
+ neutral 0.830 0.793 0.811 411
109
+ positive 0.877 0.881 0.879 243
110
+ negative 0.736 0.780 0.757 282
111
 
112
 
113