echo-1 / ml /__init__.py
lupodevelop's picture
echo-1 Stage 0 explainer: diffusion vs autoregressive, execution-verified
3afc977 verified
Raw
History Blame Contribute Delete
378 Bytes
"""echo-1 M1 — Stage 0 substrate experiment.
A tiny masked-diffusion language model vs a tiny autoregressive (FIM) baseline,
trained from scratch on pure-Lua infilling, verified by execution. The question
(RQ1): at iso wall-clock latency, does the diffusion substrate's parallel,
bidirectional refinement match or beat left-to-right AR on globally-structured
generation?
"""