LnL-AI
/

dbrx-base-tokenizer

Transformers.js

Model card Files Files and versions

dbrx-base-tokenizer

7.17 MB

1 contributor

History: 12 commits

Qubitium's picture

Upload README.md with huggingface_hub

dfadea8 verified almost 2 years ago

.gitattributes
1.52 kB

initial commit almost 2 years ago
README.md
971 Bytes

Upload README.md with huggingface_hub almost 2 years ago
merges.txt
917 kB

Upload merges.txt with huggingface_hub almost 2 years ago
special_tokens_map.json
655 Bytes

Upload special_tokens_map.json with huggingface_hub almost 2 years ago
tokenizer.json
4.23 MB

Upload tokenizer.json with huggingface_hub almost 2 years ago
tokenizer_config.json
3.16 kB

Upload tokenizer_config.json with huggingface_hub almost 2 years ago
vocab.json
2.01 MB

Upload vocab.json with huggingface_hub almost 2 years ago