metadata
license: cc-by-4.0
xlm_roberta_base_10_5e-05_512_english
Model Description
This is an xlm-roberta-base model finetuned on English training data labelled with the Illframes Climate Codebook categories:
- 710: Threatening economic growth
- 720: Threatening national sovereignty
- 721: Climate conspiracy
- 722: Scientific scepticism and denial
- 723: Climate movement bashing
- 724: Other polluters as the real problem
- 730: Threatening energy security
- 740: Threatening way of life
- 799: None of them
How to Use the Model
from transformers import AutoTokenizer, pipeline
tokenizer = AutoTokenizer.from_pretrained("xlm-roberta-base")
pipe = pipeline(
model="poltextlab/illframes-climate_v3",
task="text-classification",
tokenizer=tokenizer,
use_fast=False,
token="<your_hf_read_only_token>"
)
text = "The European Green Deal is exactly why people, our citizens, pay increasingly expensive energy and food today..."
pipe(text)
Gated Access
This model requires gated access. You must pass the token parameter when loading the model. In earlier versions of the Transformers package, you may need to use the use_auth_token parameter instead.
Model Performance
The model was evaluated on a test set of 374 English examples.
Accuracy: 0.47
Precision: 0.50
Recall: 0.47
Weighted Average F1-score: 0.48
Classification report
| Class | Precision | Recall | F1-Score | Support |
|---|---|---|---|---|
| 710 | 0.41 | 0.46 | 0.43 | 48 |
| 720 | 0.41 | 0.55 | 0.47 | 33 |
| 721 | 0.31 | 0.38 | 0.34 | 48 |
| 722 | 0.40 | 0.53 | 0.46 | 30 |
| 723 | 0.45 | 0.52 | 0.49 | 48 |
| 724 | 0.81 | 0.63 | 0.70 | 40 |
| 730 | 0.65 | 0.54 | 0.59 | 48 |
| 740 | 0.64 | 0.45 | 0.53 | 31 |
| 799 | 0.43 | 0.27 | 0.33 | 48 |