Transformers
grt
geometric-rotation-transformer
tokenizer
polar-embedding
phase-angle-embedding
rotational-transformer
qwen3
matterwave
Instructions to use MatterWaveAI/grt-30m-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MatterWaveAI/grt-30m-tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("MatterWaveAI/grt-30m-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Release MatterWaveAI/grt-30m-tokenizer (BPE tokenizer + 19.57M shared polar phase-angle embedding bank)
78b5a99 verified Download config.json from MatterWaveAI/grt-30m-tokenizer: direct link, hf CLI and curl.
- Browser
- Download file 308 Bytes
-
https://huggingface.co/MatterWaveAI/grt-30m-tokenizer/resolve/main/config.json
- Command line
-
hf download hf://MatterWaveAI/grt-30m-tokenizer/config.json
-
curl -L -o config.json https://huggingface.co/MatterWaveAI/grt-30m-tokenizer/resolve/main/config.json
308 Bytes
| { | |
| "model_type": "grt", | |
| "vocab_size": 151669, | |
| "hidden_size": 256, | |
| "n_pairs": 128, | |
| "bos_token_id": 151643, | |
| "eos_token_id": 151643, | |
| "pad_token_id": 151643, | |
| "output_scale_init": 30.0, | |
| "polar_embedding_parameters": 19565302, | |
| "polar_embedding_file": "polar_embedding.safetensors" | |
| } | |