Instructions to use SmallDoge/Doge-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SmallDoge/Doge-tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SmallDoge/Doge-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload tokenizer
Loser CheemsVerified signature786ed94
-
Upload tokenizer
Loser CheemsVerified signature3d3f3a2
-
Upload tokenizer
Loser CheemsVerified signature93381dc -
Update tokenizer_config.json
Loser CheemsVerified signature14580d8
-
Update special_tokens_map.json
Loser CheemsVerified signature7d69369 -
Delete vocab.json
Loser CheemsVerified signature0be77d0 -
Delete merges.txt
Loser CheemsVerified signature1ef3ab2 -
Upload tokenizer
Loser CheemsVerified signature2bc53ab
-
Update README.md
Loser CheemsVerified signature0f5ba3f -
Upload tokenizer
Loser CheemsVerified signature8626dcc -
initial commit
Loser CheemsVerified signature88aef59