Instructions to use Thouph/six_tokenizer_filtered_space_merge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Thouph/six_tokenizer_filtered_space_merge with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Thouph/six_tokenizer_filtered_space_merge", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Filtered the original strings so that only type 0, 5, 7 were left. Added a space at the beginning of all strings while deleted all non-alphanumeric symbols.
- Downloads last month
- 12
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support