Alo-70m-Base / tokenizer_config.json

Commit History

Update tokenizer_class to PreTrainedTokenizerFast for GGUF compatibility
dab7200
verified

spitfire4794 commited on

Update tokenizer_class to LlamaTokenizerFast for GGUF compatibility
6ccfa3b
verified

spitfire4794 commited on

Squash history to single initial commit
616f6b1

spitfire4794 commited on