Quark3Tokenizer / special_tokens_map.json

Commit History

BPE 16k tokenizer, Italian-first bilingual with ChatML
a101152
verified

ThingsAI commited on