Interactive demo: see Mesh Attention graphs & exit gate heatmaps live
#1
by vigneshwar234 - opened
Try the TMT Live Demo
This Space lets you run a full TMT forward pass in your browser β no GPU needed.
What you can do:
- Type any text β watch the $k$NN attention graph evolve across all 12 layers
- See exactly which tokens exit early (punctuation β layer 2) vs late (rare words β layer 12)
- Explore the ablation benchmark charts (PPL vs compute for all 8 configurations)
- Read the full paper and copy the citation
Demo tabs:
- β‘ Live Forward Pass β dynamic graph topology + exit gate confidence heatmap
- π Benchmarks β ablation bar chart, Pareto curve, complexity scaling, exit depth by token type
- π Architecture β full technical description of all 5 innovations
- π Paper & Citation β BibTeX, DOI, Zenodo link
The forward pass is implemented in pure NumPy (no PyTorch dependency) so it runs instantly on CPU.
Paper: https://zenodo.org/records/20287390
Code: https://github.com/vignesh2027/TemporalMesh-Transformer