tokiers
/

phi-2

Model card Files Files and versions

Commit History

Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)

052bdc1
verified

bhavnicksm commited on 23 days ago

Upload tokenizer.tkz with huggingface_hub

ba4e378
verified

bhavnicksm commited on Mar 25

Add model card README

98f968d
verified

bhavnicksm commited on Mar 24

Add special_tokens_map.json from microsoft/phi-2

17a8108
verified

bhavnicksm commited on Mar 24

Add tokenizer_config.json from microsoft/phi-2

e0bcf62
verified

bhavnicksm commited on Mar 24

Add tokenizer.json from microsoft/phi-2

7ce8206
verified

bhavnicksm commited on Mar 24

Add tokie banner

93afa79
verified

bhavnicksm commited on Mar 24

Update tokenizer.tkz to v11 (with pad_token_id)

6bad8c0
verified

bhavnicksm commited on Mar 24

initial commit

affbb01
verified

bhavnicksm commited on Mar 24