164 kB

Ctrl+K

2 contributors

History: 6 commits

Faaz

Add GPU diagnostic script, fix architecture loading with low_cpu_mem_usage and sync

5fb9ec3 about 1 month ago

add_special_tokens.py

3.28 kB
Day 1 Complete: Tokenizer setup — Qwen2.5-Coder-7B base + 22 MINDI special tokens (vocab 151,685), wrapper class, full format test about 2 months ago
data_stats.py

9.75 kB
Day 3 COMPLETE: Full model architecture about 1 month ago
download_datasets.py

35.1 kB
Day 2 COMPLETE: 1.48M examples processed, 6GB dataset, WebSight done about 1 month ago
download_tokenizer.py

2.8 kB
Day 1 Complete: Tokenizer setup — Qwen2.5-Coder-7B base + 22 MINDI special tokens (vocab 151,685), wrapper class, full format test about 2 months ago
gpu_diagnostic.py

2.27 kB
Add GPU diagnostic script, fix architecture loading with low_cpu_mem_usage and sync about 1 month ago
health_check.py

3.3 kB
feat: initial project scaffold for MINDI 1.5 Vision-Coder about 2 months ago
process_data.py

29.4 kB
Day 2 COMPLETE: 1.48M examples processed, 6GB dataset, WebSight done about 1 month ago
quality_filter.py

17.7 kB
Day 3 COMPLETE: Full model architecture about 1 month ago
save_everything.py

6.91 kB
Day 1 Complete: Tokenizer setup — Qwen2.5-Coder-7B base + 22 MINDI special tokens (vocab 151,685), wrapper class, full format test about 2 months ago
split_data.py

7.27 kB
Day 3 COMPLETE: Full model architecture about 1 month ago
test_mindi_format.py

11.4 kB
Day 1 Complete: Tokenizer setup — Qwen2.5-Coder-7B base + 22 MINDI special tokens (vocab 151,685), wrapper class, full format test about 2 months ago
train.py

12 kB
Fix train.py: mem -> memory on line 225 about 1 month ago
upload_everything_to_hf.py

11.8 kB
Day 3 COMPLETE: Full model architecture about 1 month ago
validate_setup.py

7.04 kB
feat: initial project scaffold for MINDI 1.5 Vision-Coder about 2 months ago
verify_install.py

4.01 kB
feat: initial project scaffold for MINDI 1.5 Vision-Coder about 2 months ago