MINDI-1.5-Vision-Coder / scripts /download_tokenizer.py

Commit History

Day 1 Complete: Tokenizer setup — Qwen2.5-Coder-7B base + 22 MINDI special tokens (vocab 151,685), wrapper class, full format test
11e0d89

Faaz commited on