Add tiktoken tokenizer files from Meta-Llama-3-8B-Instruct/original

README.md

@@ -13,7 +13,7 @@ This model contains the tiktoken format tokenizer.model file for testing purpose
 
 ## Files
 
-- `tokenizer.model` - TikToken format tokenizer
+- `tiktoken.model` - TikToken format tokenizer (renamed from tokenizer.model)
 - `tokenizer_config.json` - Tokenizer configuration
 - `special_tokens_map.json` - Special tokens mapping
 

tiktoken.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:82e9d31979e92ab929cd544440f129d9ecd797b69e327f80f17e1c50d5551b55
+size 2183982