Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

sangjeedondrub
/

marpa-tokenizer

Text Generation

Model card Files Files and versions

marpa-tokenizer

21.3 MB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

sangjeedondrub's picture

Create config.json

c49353b verified 11 months ago

.gitattributes

1.57 kB
Upload tokenizer 11 months ago
README.md

5.17 kB
Upload tokenizer 11 months ago
added_tokens.json

361 kB
Upload tokenizer 11 months ago
config.json

736 Bytes
Create config.json 11 months ago
merges.txt

1.67 MB
Upload tokenizer 11 months ago
special_tokens_map.json

616 Bytes
Upload tokenizer 11 months ago
tokenizer.json

14 MB
xet

Upload tokenizer 11 months ago
tokenizer_config.json

2.47 MB
Upload tokenizer 11 months ago
vocab.json

2.78 MB
Upload tokenizer 11 months ago