ocisd4
/

mistral_tokenizer_ext

Model card Files Files and versions

mistral_tokenizer_ext / tokenizer_config.json

Commit History

Update tokenizer_config.json

e516a33
verified

AlexHung29629 commited on Feb 19, 2024

Remove dummy tokens, add func_start, func_end

9c962ca

AlexHT_Hung commited on Feb 6, 2024

Add <|func_start|> <|func_end|>

a4300b1

AlexHT_Hung commited on Feb 2, 2024

Upload tokenizer

c656aa4
verified

samleeasus commited on Jan 15, 2024