ClinicNote-DeID-Baseline / tokenizer.json
SOTAagi2030's picture
Upload tokenizer.json
adc7a60 verified
Raw History Blame Contribute Delete
245 Bytes
{"version":"1.0","truncation":null,"padding":null,"added_tokens":[],"normalizer":null,"pre_tokenizer":{"type":"Whitespace"},"model":{"type":"WordLevel","vocab":{"[UNK]":0,"Patient":1,"was":2,"seen":3,"in":4,"[REDACTED]":5},"unk_token":"[UNK]"}}