|
|
--- |
|
|
license: cc-by-4.0 |
|
|
--- |
|
|
# xlm_roberta_base_10_5e-05_512_english |
|
|
|
|
|
## Model Description |
|
|
This is an **xlm-roberta-base** model finetuned on English training data labelled with the **Illframes Climate Codebook** categories: |
|
|
|
|
|
- **710**: Threatening economic growth |
|
|
- **720**: Threatening national sovereignty |
|
|
- **721**: Climate conspiracy |
|
|
- **722**: Scientific scepticism and denial |
|
|
- **723**: Climate movement bashing |
|
|
- **724**: Other polluters as the real problem |
|
|
- **730**: Threatening energy security |
|
|
- **740**: Threatening way of life |
|
|
- **799**: None of them |
|
|
|
|
|
--- |
|
|
|
|
|
## How to Use the Model |
|
|
|
|
|
```python |
|
|
from transformers import AutoTokenizer, pipeline |
|
|
|
|
|
tokenizer = AutoTokenizer.from_pretrained("xlm-roberta-base") |
|
|
pipe = pipeline( |
|
|
model="poltextlab/illframes-climate_v3", |
|
|
task="text-classification", |
|
|
tokenizer=tokenizer, |
|
|
use_fast=False, |
|
|
token="<your_hf_read_only_token>" |
|
|
) |
|
|
|
|
|
text = "The European Green Deal is exactly why people, our citizens, pay increasingly expensive energy and food today..." |
|
|
pipe(text) |
|
|
``` |
|
|
|
|
|
## Gated Access |
|
|
|
|
|
This model requires gated access. You must pass the token parameter when loading the model. |
|
|
In earlier versions of the Transformers package, you may need to use the use_auth_token parameter instead. |
|
|
|
|
|
## Model Performance |
|
|
|
|
|
The model was evaluated on a test set of 374 English examples. |
|
|
|
|
|
**Accuracy**: 0.47 |
|
|
|
|
|
**Precision**: 0.50 |
|
|
|
|
|
**Recall**: 0.47 |
|
|
|
|
|
**Weighted Average F1-score**: 0.48 |
|
|
|
|
|
## Classification report |
|
|
|
|
|
| Class | Precision | Recall | F1-Score | Support | |
|
|
| ----- | --------- | ------ | -------- | ------- | |
|
|
| 710 | 0.41 | 0.46 | 0.43 | 48 | |
|
|
| 720 | 0.41 | 0.55 | 0.47 | 33 | |
|
|
| 721 | 0.31 | 0.38 | 0.34 | 48 | |
|
|
| 722 | 0.40 | 0.53 | 0.46 | 30 | |
|
|
| 723 | 0.45 | 0.52 | 0.49 | 48 | |
|
|
| 724 | 0.81 | 0.63 | 0.70 | 40 | |
|
|
| 730 | 0.65 | 0.54 | 0.59 | 48 | |
|
|
| 740 | 0.64 | 0.45 | 0.53 | 31 | |
|
|
| 799 | 0.43 | 0.27 | 0.33 | 48 | |
|
|
|
