Commit History

Replace tokenizer.json with Xenova M2M-100 418M version (correct SP-aligned vocab IDs) for M2M-100 1.2B
a2bc8d4
verified

burakaydinofficial commited on

Replace tokenizer.json with Xenova M2M-100 418M version (correct SP-aligned vocab IDs) for SMaLL-100
2063eec
verified

burakaydinofficial commited on

Fix tokenizer.json: add language tokens to added_tokens for facebook/m2m100_1.2B
7705690
verified

burakaydinofficial commited on

Fix tokenizer.json: add language tokens to added_tokens for alirezamsh/small100
f09a6ec
verified

burakaydinofficial commited on

Add labels.json for SpeechBrain ECAPA-TDNN LID
65dc681
verified

burakaydinofficial commited on

Fix tokenizer.json for SMaLL-100 (correct BPE merge order)
5bdb2d4
verified

burakaydinofficial commited on

Fix tokenizer.json for M2M-100 1.2B (correct BPE merge order)
b6423e6
verified

burakaydinofficial commited on

Fix tokenizer.json merge order for SMaLL-100 INT8
171300f
verified

burakaydinofficial commited on

Fix tokenizer.json merge order for M2M-100 1.2B INT8
71385af
verified

burakaydinofficial commited on

Fix tokenizer.json merge order for SMaLL-100 INT8
cc45707
verified

burakaydinofficial commited on

Fix tokenizer.json merge order for M2M-100 1.2B INT8
7763816
verified

burakaydinofficial commited on

Add tokenizer.json for SMaLL-100 INT8
050b300
verified

burakaydinofficial commited on

Add tokenizer.json for M2M-100 1.2B INT8
199084d
verified

burakaydinofficial commited on