test-llama-tokenizer / tokenizer_config.json

Commit History

Sample tokenizer config
153542a

pcuenq HF Staff commited on