bihmoe-poc / docs /ARCHITECTURE.md
Throstur
meta: add contributing/roadmap/citation/architecture notes
61cc313
|
Raw
History Blame Contribute Delete
474 Bytes
# Architecture notes (high level)
This repo compares a dense baseline vs a structured "dual-stream" model on synthetic compositional tasks.
Key stabilized regime (what produced the replicated ood_long gains):
- chiasm_mode = bias (no information starvation)
- curriculum mixing that includes long+gap samples during training
- Schedule-2 with ramp; braid rehearsal prevents late-phase regression
See `docs/preliminary_results.md` for the replication panel and ablations.