fecasado
/

blueberry-cubes-tokenizer

Model card Files Files and versions

blueberry-cubes-tokenizer

1 contributor

History: 3 commits

fecasado's picture

Upload tokenizer metadata

087fdeb verified about 2 months ago

.gitattributes

1.52 kB

initial commit about 2 months ago
README.md

5.17 kB

Upload FAST tokenizer trained on fecasado/blueberry-cubes about 2 months ago
metadata.json

614 Bytes

Upload tokenizer metadata about 2 months ago
processing_action_tokenizer.py

6.15 kB

Upload FAST tokenizer trained on fecasado/blueberry-cubes about 2 months ago
processor_config.json

250 Bytes

Upload FAST tokenizer trained on fecasado/blueberry-cubes about 2 months ago
special_tokens_map.json

3 Bytes

Upload FAST tokenizer trained on fecasado/blueberry-cubes about 2 months ago
tokenizer.json

90.5 kB

Upload FAST tokenizer trained on fecasado/blueberry-cubes about 2 months ago
tokenizer_config.json

353 Bytes

Upload FAST tokenizer trained on fecasado/blueberry-cubes about 2 months ago