Hugging Face's logo

ace-1
/
mgpt2-pretrain

Text Generation
English
Hindi
Kannada
mgpt2
causal-lm
multilingual
indic
hindi
kannada
from-scratch
Model card Files
xet
 Community
mgpt2-pretrain / tokenization_mgpt2.py
ace-1's picture
ace-1
Publish mgpt2 pretrain checkpoint (step 27537, val_loss 2.5003)
7a2cd59 verified
raw
history blame contribute delete
80 Bytes
from tokenizer.hf_tokenizer import MGPT2Tokenizer
__all__ = ['MGPT2Tokenizer']