zils-mini-t2a
A body for the Zils d3-mini soup pool (Bittensor subnet 127): a fine-tune of Qwen/Qwen3.5-4B in the chassis layout, BF16, language weights trained, vision tower from the parent.
Soup fine-tune: start = uniform average of the two current z3-mini soup bodies; one rank-64 LoRA run (lr 5e-5, one epoch) merged into the start.
Training data: exam-format decision items written with the public Zils authoring recipe (scripts/author_exam.py) by Claude Opus and by a local open model, from public dataset rows: train-side splits for the known task families; for the new-domain style tasks, rows of the public new-domain task pools listed in scripts/author_exam.py (BIG-bench task files and splits of other public datasets, mostly held-out validation/test splits; BIG-bench tasks used by the public seed exams were excluded), plus the public Zils relay teacher answers. No validator exam items and no public seed items were used. This repository holds weights only; check the source datasets' terms before reuse.
Model tree for Charlie320/zils-mini-t2a
Base model
Qwen/Qwen3.5-4B-Base