Instructions to use l3cube-pune/marathi-tweets-bert-scratch with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use l3cube-pune/marathi-tweets-bert-scratch with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="l3cube-pune/marathi-tweets-bert-scratch")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("l3cube-pune/marathi-tweets-bert-scratch") model = AutoModelForMaskedLM.from_pretrained("l3cube-pune/marathi-tweets-bert-scratch") - Notebooks
- Google Colab
- Kaggle
MahaTweetBERT-Scratch
A base BERT model trained on Marathi Tweets. More details on the dataset, models, and baseline results can be found in our [paper] ( link )
Released under project: https://github.com/l3cube-pune/MarathiNLP
A better version of model is available here: https://huggingface.co/l3cube-pune/marathi-tweets-bert
@article{gokhale2022spread,
title={Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection},
author={Gokhale, Omkar and Kane, Aditya and Patankar, Shantanu and Chavan, Tanmay and Joshi, Raviraj},
journal={arXiv preprint arXiv:2210.04267},
year={2022}
}
Other Models trained from scratch are listed below:
Marathi-Scratch
Marathi-Tweets-Scratch
Hindi-Scratch
Dev-Scratch
Kannada-Scratch
Telugu-Scratch
Malayalam-Scratch
Gujarati-Scratch
Better versions of Monolingual Indic BERT models are listed below:
Marathi BERT
Marathi RoBERTa
Marathi AlBERT
Hindi BERT
Hindi RoBERTa
Hindi AlBERT
Dev BERT
Dev RoBERTa
Dev AlBERT
Kannada BERT
Telugu BERT
Malayalam BERT
Tamil BERT
Gujarati BERT
Oriya BERT
Bengali BERT
Punjabi BERT
- Downloads last month
- 4