Update README.md
Browse filesAdded Interpretation
README.md
CHANGED
|
@@ -28,7 +28,8 @@ Utilizing this approach, we demonstrated improvements in regression tasks for ev
|
|
| 28 |
# main
|
| 29 |
|
| 30 |
|
| 31 |
-
|
|
|
|
| 32 |
|
| 33 |
# augmented
|
| 34 |
|
|
@@ -46,6 +47,22 @@ Utilizing this approach, we demonstrated improvements in regression tasks for ev
|
|
| 46 |
|
| 47 |

|
| 48 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 49 |
## Acknowledgements
|
| 50 |
|
| 51 |
We would like to acknowledge the authors of the ValueNet dataset for their valuable contribution to this work.
|
|
|
|
| 28 |
# main
|
| 29 |
|
| 30 |
|
| 31 |
+
|
| 32 |
+

|
| 33 |
|
| 34 |
# augmented
|
| 35 |
|
|
|
|
| 47 |
|
| 48 |

|
| 49 |
|
| 50 |
+
# Interpretation
|
| 51 |
+
|
| 52 |
+
We can only compare our classification task with the BART model that has the highest classification. This model only classifies whether the value is present or not.
|
| 53 |
+
1 for present and 0 for not. Qiu et al (2022) used BART to perform this classification with the highest accuracy using the main dataset with 67%. Using DeBERTa v3,
|
| 54 |
+
we were able to get an accuracy of 73% (0.7283). DeBERTa's disentanglement feature allows for a significant improvement in classifying human values.
|
| 55 |
+
|
| 56 |
+
We can also see a very noticable improvement with the regression tasks. This is a more difficult task, because the model must determine if the value in question is either
|
| 57 |
+
present or not; then determine if the agent's perspective is either supporting or against the value's stance. However, we can see that DeBerta v3 outperforms BERT by 4% (65% vs 61%).
|
| 58 |
+
I simply just replicated Qiu et al (2022) and have not tried to improve their design.
|
| 59 |
+
|
| 60 |
+
# Future Work
|
| 61 |
+
|
| 62 |
+
I am currently working to develop and ensemble model that will leverage text generation to create multiple stance positions for each values. We hypothesize that if
|
| 63 |
+
the model can differentiate between different stance positions on the same topic associated with the target value, the model can more accurately predict an agents
|
| 64 |
+
values stance.
|
| 65 |
+
|
| 66 |
## Acknowledgements
|
| 67 |
|
| 68 |
We would like to acknowledge the authors of the ValueNet dataset for their valuable contribution to this work.
|