Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
toksuite
/
supertoken_models-llama_gpt2
like
0
Follow
TokSuite
6
Text Generation
Transformers
Safetensors
toksuite/toksuite_pretraining_data
5 languages
llama
toksuite
tokenization
gpt2
bpe
research
robustness
text-generation-inference
arxiv:
2512.20757
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
supertoken_models-llama_gpt2
2.98 GB
2 contributors
History:
35 commits
gsaltintas
Update README.md
4b9e9a0
verified
11 days ago
.gitattributes
1.64 kB
Upload model-performance-comparison.png
16 days ago
README.md
8.01 kB
Update README.md
11 days ago
config.json
609 Bytes
Upload config
4 months ago
generation_config.json
150 Bytes
Upload model files
4 months ago
gpt2.yaml
56 Bytes
Upload tokenizer file gpt2.yaml - Upload model files
4 months ago
gpt2_super_mapping.json
827 kB
Upload tokenizer file gpt2_super_mapping.json - Upload model files
4 months ago
model-performance-comparison.png
279 kB
xet
Upload model-performance-comparison.png
16 days ago
model.safetensors
2.98 GB
xet
Upload model files
4 months ago
tokenizer.json
977 kB
Upload tokenizer file gpt2_vocab.json - Upload model files
4 months ago
tokenizer_config.json
64 Bytes
Upload tokenizer file gpt2_info.json - Upload model files
4 months ago
toksuite-logo.png
1 MB
xet
Upload toksuite-logo.png
18 days ago
