hf-internal-testing
/

llama3-tokenizer-tiktoken

Model card Files Files and versions

llama3-tokenizer-tiktoken

Commit History

Delete tokenizer.model

a1d81e8
verified

itazap HF Staff commited on 13 days ago

Add tiktoken tokenizer files from Meta-Llama-3-8B-Instruct/original

c8bff8b
verified

itazap HF Staff commited on 13 days ago

Add tiktoken tokenizer files from Meta-Llama-3-8B-Instruct/original

7862ff8
verified

itazap HF Staff commited on 13 days ago

initial commit

5bc9fcf
verified

itazap HF Staff commited on 13 days ago