thenlpresearcher
/

iitb-en-indic-without-punct

text2text-generation

Generated from Trainer

punctuation-robustness

Eval Results (legacy)

Model card Files Files and versions

Metrics Training metrics Community

thenlpresearcher commited on Nov 23, 2025

Commit

206c0ff

·

verified ·

1 Parent(s): 43cd16c

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -2

tokenizer_config.json CHANGED Viewed

@@ -46,8 +46,7 @@
   "extra_special_tokens": {},
   "model_max_length": 256,
   "pad_token": "<pad>",
-  "src_vocab_file": "thenlpresearcher/iitb-en-indic-without-punct/dict.SRC.json",
-  "tgt_vocab_file": "thenlpresearcher/iitb-en-indic-without-punct/dict.TGT.json",
   "tokenizer_class": "IndicTransTokenizer",
   "unk_token": "<unk>"
 }

   "extra_special_tokens": {},
   "model_max_length": 256,
   "pad_token": "<pad>",
   "tokenizer_class": "IndicTransTokenizer",
   "unk_token": "<unk>"
 }