| | --- |
| | language: |
| | - da |
| |
|
| | tags: |
| | - climate change |
| | - climate-classifier |
| | - political quotes |
| | - klimabert |
| |
|
| | --- |
| | |
| | # Identifying and Analysing political quotes from the Danish Parliament related to climate change using NLP |
| | **KlimaBERT**, a sequence-classifier fine-tuned to predict whether political quotes are climate-related. When predicting the positive class 1, "climate-related", the model achieves a F1-score of 0.97, Precision of 0.97, and Recall of 0.97. The negative class, 0, is defined as "non-climate-related". |
| |
|
| | KlimaBERT is fine-tuned using the pre-trained DaBERT-uncased model, on a training set of 1.000 manually labelled data-points. The training set contains both political quotes and summaries of bills from the [Danish Parliament](https://www.ft.dk/). |
| |
|
| | The model is created to identify political quotes related to climate change, and performs best on official texts from the Danish Parliament. |
| |
|
| | ### Fine-tuning |
| | To fine-tune a model similar to KlimaBERT, follow the [fine-tuning notebooks](https://github.com/jonahank/Vote-Prediction-Model/tree/main/climate_classifier) |
| |
|
| | ### References |
| | BERT: |
| | Devlin, J., M.-W. Chang, K. Lee, and K. Toutanova (2018). Bert: Pre-training of deep |
| | bidirectional transformers for language understanding. |
| | https://arxiv.org/abs/1810.04805 |
| |
|
| | DaBERT: |
| | Certainly (2021). Certainly has trained the most advanced danish bert model to date. |
| | https://www.certainly.io/blog/danish-bert-model/. |
| |
|
| | ### Acknowledgements |
| | The resources are created through the work of my Master's thesis, so I would like to thank my supervisors [Leon Derczynski](https://www.derczynski.com/itu/) and [Vedran Sekara](https://vedransekara.github.io/) for the great support throughout the project! And a HUGE thanks to [Gustav Gyrst](https://github.com/Gyrst) for great sparring and co-development of the tools you find in this repo. |
| |
|
| |
|
| | ### Contact |
| | For any further help, questions, comments etc. feel free to contact the author Jonathan Kristensen on [LinedIn](https://www.linkedin.com/in/jonathan-kristensen-444a96104) or by creating a "discussion" on this model's page. |
| |
|
