saroyehun commited on
Commit
c840fa4
·
verified ·
1 Parent(s): 160db58

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -3
README.md CHANGED
@@ -1,3 +1,58 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ ---
6
+ This is a BERT model trained on the U.S. Comparative Agendas Project (CAP) dataset, annotated with a top-level taxonomy covering 20 policy areas, as well as an "Others" category for non-policy-related text. The model is designed to identify policy and non-policy issues in political discourse.
7
+
8
+ The performance of the model on an unseen test set is as follows:
9
+
10
+ This is a BERT model trained on the US Comparative Agendas Project dataset for the U.S. with annotations for the top level taxonomy covering 20 policy areas and Others for non-policy related text.
11
+ The model can be used to identify policy (non-policy)issues political discourse.
12
+
13
+ ## Model performance
14
+
15
+ The model performance on unseen test set is as follows:
16
+
17
+ <div align="center">
18
+
19
+ | Label | F1 score |
20
+ |:----------------------|-----------:|
21
+ | Macroeconomics | 0.8303 |
22
+ | Civil rights | 0.7676 |
23
+ | Health | 0.8886 |
24
+ | Agriculture | 0.8439 |
25
+ | Labor | 0.7818 |
26
+ | Education | 0.9005 |
27
+ | Environment | 0.8481 |
28
+ | Energy | 0.8629 |
29
+ | Immigration | 0.8682 |
30
+ | Transportation | 0.8731 |
31
+ | Law and crime | 0.8207 |
32
+ | Social welfare | 0.7957 |
33
+ | Housing | 0.8462 |
34
+ | Domestic commerce | 0.8421 |
35
+ | Defense | 0.8627 |
36
+ | Technology | 0.8333 |
37
+ | Foreign trade | 0.8269 |
38
+ | International affairs | 0.8907 |
39
+ | Government operations | 0.8777 |
40
+ | Public lands | 0.8758 |
41
+ | Others | 0.6543 |
42
+ | **Macro average** | **0.8573** |
43
+
44
+ </div>
45
+
46
+
47
+ This model was trained specifically for additional analyses presented in this [paper](https://doi.org/10.48550/arXiv.2405.07323).
48
+
49
+ ## Citation
50
+ If you find this model useful for your work, please consider citing:
51
+ ```bibtex
52
+ @article{aroyehun2024computational,
53
+ title={Computational analysis of US Congressional speeches reveals a shift from evidence to intuition},
54
+ author={Aroyehun, Segun Taofeek and Simchon, Almog and Carrella, Fabio and Lasser, Jana and Lewandowsky, Stephan and Garcia, David},
55
+ journal={arXiv preprint arXiv:2405.07323},
56
+ year={2024}
57
+ }
58
+ ```