bihmoe-poc / src /bihmoe /models /structured.py

Commit History

arch: add chiasm_mode=bias to avoid global-branch starvation
74790c5

Throstur commited on

arch-v2.3: confidence-gated output fusion (stabilize ood_long)
abf1df3

Throstur commited on

arch-v2.2: add QUERY type + soft optic-chiasm split (route query/mid/val to right)
2f2cb64

Throstur commited on

fix: restore lb_loss aux + robust logging; update GradScaler API
622be4a

Throstur commited on

arch-v2: asymmetry (local vs global), competitive callosum, optic-chiasm bias; default stem=0
74c312e

Throstur commited on

moe: add router warmup (round-robin expert) to reduce seed variance
b5456f3

Throstur commited on

moe: add load-balance loss + training hook (reduce seed variance)
40ccd7e

Throstur commited on

head: make models query-aware (last-token readout) + trainer update
d9fbc8a

Throstur commited on

poc: add bind_query task + english render + side-by-side trainer
da4cb42

Throstur commited on

probe: add minimal dense + structured models and VRAM probe script
14847f9

Throstur commited on