jerin/pib
Updated • 182 • 3
How to use vasudevgupta/mbart-iitb-hin-eng with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("vasudevgupta/mbart-iitb-hin-eng")
model = AutoModelForSeq2SeqLM.from_pretrained("vasudevgupta/mbart-iitb-hin-eng", device_map="auto")mBART (a pre-trained model by Facebook) is pre-trained to de-noise multiple languages simultaneously with BART objective.
Checkpoint available in this repository is obtained after fine-tuning facebook/mbart-large-cc25 on 0.5 M samples from IIT-B Hindi-English parallel corpus. This checkpoint gives decent results for Hindi-english translation.