Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
allenai
/
olmo-3-tokenizer-instruct-dev
like
1
Follow
Ai2
5.26k
Transformers
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
olmo-3-tokenizer-instruct-dev
7.2 MB
2 contributors
History:
6 commits
saumyamalik
remove identity from system prompt
18e91cf
3 months ago
.gitattributes
1.52 kB
initial commit
5 months ago
README.md
3.6 kB
Update README.md
4 months ago
fix_tokens.py
22.8 kB
remove identity from system prompt
3 months ago
generation_config.json
153 Bytes
v5 - no additions to provided system prompt
5 months ago
merges.txt
917 kB
v5 - no additions to provided system prompt
5 months ago
special_tokens_map.json
580 Bytes
v5 - no additions to provided system prompt
5 months ago
tokenizer.json
4.24 MB
functions inuser messages ignored
5 months ago
tokenizer_config.json
6.94 kB
remove identity from system prompt
3 months ago
vocab.json
2.01 MB
functions inuser messages ignored
5 months ago