llama_8K_extended / tokenizer_config.json
Billyyy's picture
Add agglutination-optimized tokenizer
a8304ea verified
raw
history contribute delete
1.26 MB
File too large to display, you can check the raw version instead.