Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
allenai
/
olmo-3-tokenizer-instruct-dev
like
1
Follow
Ai2
5.8k
Transformers
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
26d1356
olmo-3-tokenizer-instruct-dev
7.2 MB
Ctrl+K
Ctrl+K
2 contributors
History:
3 commits
saumyamalik
removed unused special tokens
26d1356
7 months ago
.gitattributes
Safe
1.52 kB
initial commit
7 months ago
README.md
3.73 kB
v5 - no additions to provided system prompt
7 months ago
fix_tokens.py
23.1 kB
removed unused special tokens
7 months ago
generation_config.json
Safe
153 Bytes
v5 - no additions to provided system prompt
7 months ago
merges.txt
Safe
917 kB
v5 - no additions to provided system prompt
7 months ago
special_tokens_map.json
Safe
580 Bytes
v5 - no additions to provided system prompt
7 months ago
tokenizer.json
4.24 MB
removed unused special tokens
7 months ago
tokenizer_config.json
7.27 kB
removed unused special tokens
7 months ago
vocab.json
2.01 MB
removed unused special tokens
7 months ago
