Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
stabilityai
/
arcade100k
like
3
Follow
Stability AI
36.6k
arxiv:
2402.17834
Model card
Files
Files and versions
xet
Community
dfe1f6f
arcade100k
1.7 MB
Ctrl+K
Ctrl+K
2 contributors
History:
18 commits
jon-tow
fix: make `eos_token`/`pad_token` overridable
dfe1f6f
over 2 years ago
.gitattributes
Safe
1.52 kB
initial commit
over 2 years ago
LICENSE
6.9 kB
fix: update license
over 2 years ago
README.md
258 Bytes
Update README.md
over 2 years ago
arcade100k.tiktoken
Safe
1.68 MB
fix: store `cl100k_base` mergeable ranks in `arcade100k.tiktoken`
over 2 years ago
tokenization_arcade100k.py
9.6 kB
fix: make `eos_token`/`pad_token` overridable
over 2 years ago
tokenizer_config.json
Safe
224 Bytes
fix: make `eos_token`/`pad_token` overridable
over 2 years ago
