allenai
/

olmo-3.2-tokenizer-think-dev

Model card Files Files and versions

olmo-3.2-tokenizer-think-dev

7.2 MB

1 contributor

History: 4 commits

saumyamalik's picture

Update chat template to handle empty lists

cf6d929 10 days ago

.gitattributes

1.52 kB

initial commit about 1 month ago
README.md

3.57 kB

Add all tokenizer files from v5-lc-reasoner about 1 month ago
fix_tokens.py

20.3 kB

Add all tokenizer files from v5-lc-reasoner about 1 month ago
generation_config.json

153 Bytes

Add all tokenizer files from v5-lc-reasoner about 1 month ago
merges.txt

917 kB

Add all tokenizer files from v5-lc-reasoner about 1 month ago
special_tokens_map.json

580 Bytes

Add all tokenizer files from v5-lc-reasoner about 1 month ago
tokenizer.json

4.24 MB

Add all tokenizer files from v5-lc-reasoner about 1 month ago
tokenizer_config.json

7.06 kB

Update chat template to handle empty lists 10 days ago
vocab.json

2.01 MB

Add all tokenizer files from v5-lc-reasoner about 1 month ago