eevvgg commited on
Commit
62d3dae
·
1 Parent(s): 20565fc

up readme distil

Browse files
Files changed (1) hide show
  1. README.md +14 -21
README.md CHANGED
@@ -28,16 +28,16 @@ model-index:
28
  name: unpublished # Required. A pretty name for the dataset. Example: Common Voice (French)
29
  metrics:
30
  - type: f1
31
- value: 81.6
32
  - type: accuracy
33
- value: 81.2
34
  ---
35
 
36
  # eevvgg/StanceBERTa
37
 
38
  <!-- Provide a quick summary of what the model is/does. -->
39
 
40
- This model is a fine-tuned version of **roberta-base** model to predict 3 categories of stance (negative, positive, neutral) towards some entity mentioned in the text.
41
  Fine-tuned on a larger and more balanced data sample compared with the previous version [eevvgg/BEtMan-Tw](https://huggingface.co/eevvgg/BEtMan-Tw).
42
 
43
 
@@ -45,7 +45,7 @@ Fine-tuned on a larger and more balanced data sample compared with the previous
45
 
46
  - **Model type:** RoBERTa for stance classification
47
  - **Language(s) (NLP):** English social media data from Twitter and Reddit
48
- - **Finetuned from model:** [roberta-base](roberta-base)
49
 
50
 
51
  ## Uses
@@ -82,9 +82,9 @@ Normalization of user mentions and hyperlinks to "user" and "url" tokens, respec
82
 
83
  ### Training Hyperparameters
84
 
85
- - trained for 2 epochs, mini-batch size of 8.
86
- - loss: 0.556
87
- - learning_rate: 4e-5; weight_decay: 1e-2
88
 
89
  ## Evaluation
90
 
@@ -92,22 +92,15 @@ Normalization of user mentions and hyperlinks to "user" and "url" tokens, respec
92
 
93
  - evaluation on 15% of data.
94
 
95
- - accuracy: 0.812
96
  - macro avg:
97
- - f1: 0.816
98
- - precision: 0.814
99
- - recall: 0.818
100
  - weighted avg:
101
- - f1: 0.812
102
- - precision: 0.814
103
- - recall: 0.812
104
-
105
- precision recall f1-score support
106
-
107
- neutral 0.830 0.793 0.811 411
108
- positive 0.877 0.881 0.879 243
109
- negative 0.736 0.780 0.757 282
110
-
111
 
112
 
113
  ## Citation
 
28
  name: unpublished # Required. A pretty name for the dataset. Example: Common Voice (French)
29
  metrics:
30
  - type: f1
31
+ value: 77.8
32
  - type: accuracy
33
+ value: 78.5
34
  ---
35
 
36
  # eevvgg/StanceBERTa
37
 
38
  <!-- Provide a quick summary of what the model is/does. -->
39
 
40
+ This model is a fine-tuned version of **distilroberta-base** model to predict 3 categories of stance (negative, positive, neutral) towards some entity mentioned in the text.
41
  Fine-tuned on a larger and more balanced data sample compared with the previous version [eevvgg/BEtMan-Tw](https://huggingface.co/eevvgg/BEtMan-Tw).
42
 
43
 
 
45
 
46
  - **Model type:** RoBERTa for stance classification
47
  - **Language(s) (NLP):** English social media data from Twitter and Reddit
48
+ - **Finetuned from model:** [distilroberta-base](distilroberta-base)
49
 
50
 
51
  ## Uses
 
82
 
83
  ### Training Hyperparameters
84
 
85
+ - trained for 3 epochs, mini-batch size of 8.
86
+ - loss: 0.509
87
+ - learning_rate: 5e-5; weight_decay: 1e-2
88
 
89
  ## Evaluation
90
 
 
92
 
93
  - evaluation on 15% of data.
94
 
95
+ - accuracy: 0.785
96
  - macro avg:
97
+ - f1: 0.778
98
+ - precision: 0.779
99
+ - recall: 0.778
100
  - weighted avg:
101
+ - f1: 0.786
102
+ - precision: 0.786
103
+ - recall: 0.785
 
 
 
 
 
 
 
104
 
105
 
106
  ## Citation