Replace tokenizer.json with Xenova M2M-100 418M version (correct SP-aligned vocab IDs) for M2M-100 1.2B

Files changed (1) hide show

m2m100-1.2b-int8/tokenizer.json CHANGED Viewed

The diff for this file is too large to render. See raw diff