README.md

---
license: cc-by-nc-3.0
language:
- en
metrics:
- accuracy
- recall
- precision
- f1
base_model:
- FacebookAI/roberta-base
pipeline_tag: text-classification

---


# Model Card for Model ID

This model card provides details for the roberta-offensive-classifier, a binary text classification model fine-tuned to detect offensive and hateful language. Built on top of FacebookAI's RoBERTa-base architecture, it is intended for moderation of user-generated content.
This model is built as part of the [DTCCT](https://act-agi.github.io/) project.

## Model Details

### Model Description

- **Developed by:** Kanishk Verma.
- **Funded by:** Google and Research Ireland under grant number EPSPG/2021/161
- **Model type:** Sequence Classification (Binary)
- **Language(s) (NLP):** EN
- **License:** cc-by-nc-3.0
- **Finetuned from model :** FacebookAI/roberta-base

<!--
### Model Sources

 Provide the basic links for the model. 

- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]
 -->
## Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

### Direct Use

The model can be used for classifying English text as offensive or non-offensive, supporting automated moderation in:
- Social media platforms
- Forums
- Online communities


### Downstream Use 

The model can be integrated into moderation pipelines or tools with additional features such as user feedback, flagging systems, or multi-language support.

### Out-of-Scope Use

This model should not be used for:

- Legal decision-making
- Real-time moderation without human oversight
- Texts in languages other than English


## Bias, Risks, and Limitations

The model is trained on datasets labeled for offensive and hateful language and may carry annotation biases. It may not generalize well to niche domains or novel forms of offensive speech.

### Recommendations

- Human review should accompany model predictions in sensitive contexts.
- Evaluate on target data before deployment.
- Be cautious of over-filtering legitimate speech.

## How to Get Started with the Model

```python
from transformers import pipeline

classifier = pipeline("text-classification", model="adaptcentre/roberta-offensive-classifier")
classifier("Your input text here")
```


## Training Details

### Training Data

Trained on a composite dataset targeting:
- Offensive language
- Hate speech
- Toxicity
<!--
### Training Procedure


#### Preprocessing [optional]

[More Information Needed]


#### Training Hyperparameters

- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
<!--
#### Speeds, Sizes, Times [optional]

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. 

[More Information Needed]

## Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

### Testing Data, Factors & Metrics
<!--
#### Testing Data

<!-- This should link to a Dataset Card if possible. 

[More Information Needed]

#### Factors

<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->

[More Information Needed]
-->
#### Metrics
- accuracy
- precision
- recall
- f1

### Results

| Metric    | Score  |
| --------- | ------ |
| Accuracy  | 0.8856 |
| Precision | 0.8334 |
| Recall    | 0.7932 |
| F1 Score  | 0.8128 |


#### Summary

The model demonstrates solid performance across all major classification metrics, suitable for content moderation tasks with English text.
<!--
## Model Examination [optional]

<!-- Relevant interpretability work for the model goes here 

[More Information Needed]

## Environmental Impact

<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly

Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).

- **Hardware Type:** [More Information Needed]
- **Hours used:** [More Information Needed]
- **Cloud Provider:** [More Information Needed]
- **Compute Region:** [More Information Needed]
- **Carbon Emitted:** [More Information Needed]

## Technical Specifications [optional]

### Model Architecture and Objective

[More Information Needed]

### Compute Infrastructure

[More Information Needed]

#### Hardware

[More Information Needed]

#### Software

[More Information Needed]

## Citation [optional]

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
 -->
**BibTeX:**

@misc{roberta-offensive-2025,
  title = {RoBERTa Base Offensive Language Classifier},
  author = {Kanishk Verma},
}
<!--
**APA:**

[More Information Needed]

## Glossary [optional]

<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card.

[More Information Needed]

## More Information [optional]

[More Information Needed]

## Model Card Authors [optional]

[More Information Needed]

## Model Card Contact

[More Information Needed]
 -->