tokiers
/

o200k

Model card Files Files and versions

Commit History

Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)

dac00f6
verified

bhavnicksm commited on 24 days ago

Upload tokenizer.tkz with huggingface_hub

7a75742
verified

bhavnicksm commited on Mar 25

Add model card README

b012676
verified

bhavnicksm commited on Mar 24

Add special_tokens_map.json from Xenova/gpt-4o

6028db1
verified

bhavnicksm commited on Mar 24

Add tokenizer_config.json from Xenova/gpt-4o

655047b
verified

bhavnicksm commited on Mar 24

Add tokenizer.json from Xenova/gpt-4o

c23743f
verified

bhavnicksm commited on Mar 24

Add tokie banner

9b6bb26
verified

bhavnicksm commited on Mar 24

Update tokenizer.tkz to v11 (with pad_token_id)

c4a0d9b
verified

bhavnicksm commited on Mar 24

initial commit

9a7fc26
verified

bhavnicksm commited on Mar 24