flexitok
/

supertokenizer-industry-bigscience-bloom

Model card Files Files and versions

supertokenizer-industry-bigscience-bloom

33.2 MB

Ctrl+K

Ctrl+K

1 contributor

History: 13 commits

gsaltintas's picture

Upload industry-from-llama/bigscience--bloom_overlap.json with huggingface_hub

f8df611 verified 25 days ago

industry-from-llama
Upload industry-from-llama/bigscience--bloom_overlap.json with huggingface_hub 25 days ago
.gitattributes

1.67 kB
Upload industry-from-llama/bigscience--bloom_vocab.json with huggingface_hub 25 days ago
bigscience--bloom.yaml

68 Bytes
Upload bigscience--bloom.yaml with huggingface_hub 25 days ago
bigscience--bloom_info.json

76 Bytes
Upload bigscience--bloom_info.json with huggingface_hub 25 days ago
bigscience--bloom_overlap.json

1.95 kB
Upload bigscience--bloom_overlap.json with huggingface_hub 25 days ago
bigscience--bloom_super_mapping.json

4.37 MB
Upload bigscience--bloom_super_mapping.json with huggingface_hub 25 days ago
bigscience--bloom_vocab.json

12.3 MB
xet

Upload bigscience--bloom_vocab.json with huggingface_hub 25 days ago
participating_tokenizers.json

358 Bytes
Upload participating_tokenizers.json with huggingface_hub 25 days ago