theo-ultimate / tokenizer.json

Commit History

Cell5: Theo surgery on Qwen3.5-0.8B
8d22c48
verified

Youwongai commited on

Cell 3: New tokenizer trained on 100,000 FineWeb docs
d4d1de7
verified

Youwongai commited on

Upload tokenizer.json with huggingface_hub
2c582d3
verified

Youwongai commited on