File size: 2,028 Bytes
c840fa4
 
 
 
 
7e1d390
c840fa4
083fdd3
87dfe17
 
c840fa4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
565ed38
c840fa4
083fdd3
 
 
 
 
 
 
c840fa4
083fdd3
c840fa4
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
---
license: mit
language:
- en
---
This is a transformers model trained on the U.S. Comparative Agendas Project (CAP) dataset, annotated with a top-level taxonomy covering 20 policy areas, as well as an "Others" category for non-policy-related text. The model is designed to identify policy and non-policy issues in political discourse.

This model was trained specifically for additional analyses presented in this [paper](https://doi.org/10.1038/s41562-025-02136-2).



## Model performance

The model performance on unseen test set is as follows:

<div align="center">
  
| Label                 |   F1 score |
|:----------------------|-----------:|
| Macroeconomics        |     0.8303 |
| Civil rights          |     0.7676 |
| Health                |     0.8886 |
| Agriculture           |     0.8439 |
| Labor                 |     0.7818 |
| Education             |     0.9005 |
| Environment           |     0.8481 |
| Energy                |     0.8629 |
| Immigration           |     0.8682 |
| Transportation        |     0.8731 |
| Law and crime         |     0.8207 |
| Social welfare        |     0.7957 |
| Housing               |     0.8462 |
| Domestic commerce     |     0.8421 |
| Defense               |     0.8627 |
| Technology            |     0.8333 |
| Foreign trade         |     0.8269 |
| International affairs |     0.8907 |
| Government operations |     0.8777 |
| Public lands          |     0.8758 |
| Others                |     0.6543 |
| **Macro average**         |     **0.8573** |

</div>


## Citation
If you find this model useful for your work, please cite:
```bibtex
@article{aroyehun2025computational,
  title={Computational analysis of US congressional speeches reveals a shift from evidence to intuition},
  author={Aroyehun, Segun T and Simchon, Almog and Carrella, Fabio and Lasser, Jana and Lewandowsky, Stephan and Garcia, David},
  journal={Nature Human Behaviour},
  year={2025},
  doi={10.1038/s41562-025-02136-2},
  url={https://doi.org/10.1038/s41562-025-02136-2}  
}

```