fix: export standard special_tokens_map.json for AutoTokenizer 94063ba verified SurendraVB commited on 14 days ago
fix: export standard tokenizer_config.json for AutoTokenizer 0ecce52 verified SurendraVB commited on 14 days ago
feat: add tokenizer_config.json for AutoTokenizer support 17e2908 verified SurendraVB commited on 14 days ago
docs: add comprehensive model card README for Synaptic Edge 65k Tokenizer af6b57a verified SurendraVB commited on 14 days ago
feat: release official Synaptic Edge 65,536 ByteLevel BPE merges.txt 1d09a98 verified SurendraVB commited on 14 days ago
feat: release official Synaptic Edge 65,536 ByteLevel BPE vocab.json 49cb8f1 verified SurendraVB commited on 14 days ago
feat: release official Synaptic Edge 65,536 ByteLevel BPE tokenizer.json c282c89 verified SurendraVB commited on 14 days ago