Tercet-base / special_token_ids.json
kerzgrr's picture
Release Tercet-base pretrained EMA checkpoint
d8b65a5 verified
Raw
History Blame Contribute Delete
217 Bytes
{
"bos_token": "<|begin_of_text|>",
"eos_token": "<|end_of_text|>",
"pad_token": "<|padding|>",
"unk_token": "<|unknown|>",
"bos_token_id": 0,
"eos_token_id": 1,
"pad_token_id": 2,
"unk_token_id": 3
}