tokiers
/

o200k

Model card Files Files and versions

Commit History

Upload tokenizer.tkz with huggingface_hub

7a75742
verified

bhavnicksm commited on Mar 25

Add model card README

b012676
verified

bhavnicksm commited on Mar 24

Add special_tokens_map.json from Xenova/gpt-4o

6028db1
verified

bhavnicksm commited on Mar 24

Add tokenizer_config.json from Xenova/gpt-4o

655047b
verified

bhavnicksm commited on Mar 24

Add tokenizer.json from Xenova/gpt-4o

c23743f
verified

bhavnicksm commited on Mar 24

Add tokie banner

9b6bb26
verified

bhavnicksm commited on Mar 24

Update tokenizer.tkz to v11 (with pad_token_id)

c4a0d9b
verified

bhavnicksm commited on Mar 24

initial commit

9a7fc26
verified

bhavnicksm commited on Mar 24