Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Datdanboi25
/
GPT-X2-TOK-32K
like
1
HuggingFaceFW/fineweb-edu
English
tokenizer
bpe
fineweb
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
GPT-X2-TOK-32K
4.65 MB
Ctrl+K
Ctrl+K
1 contributor
History:
8 commits
Datdanboi25
Update README.md
f5d5d95
verified
6 days ago
.gitattributes
Safe
1.52 kB
initial commit
14 days ago
README.md
Safe
1.56 kB
Update README.md
6 days ago
special_tokens_map.json
Safe
129 Bytes
TOKFILES
11 days ago
tokenizer copy.json
Safe
2.32 MB
TOKFILES
11 days ago
tokenizer.json
Safe
2.32 MB
-
14 days ago
tokenizer_config.json
Safe
246 Bytes
TOKFILES
11 days ago