Interactive demo: see Mesh Attention graphs & exit gate heatmaps live

#1
by vigneshwar234 - opened

Try the TMT Live Demo

This Space lets you run a full TMT forward pass in your browser β€” no GPU needed.

What you can do:

  • Type any text β†’ watch the $k$NN attention graph evolve across all 12 layers
  • See exactly which tokens exit early (punctuation β†’ layer 2) vs late (rare words β†’ layer 12)
  • Explore the ablation benchmark charts (PPL vs compute for all 8 configurations)
  • Read the full paper and copy the citation

Demo tabs:

  1. ⚑ Live Forward Pass β€” dynamic graph topology + exit gate confidence heatmap
  2. πŸ“Š Benchmarks β€” ablation bar chart, Pareto curve, complexity scaling, exit depth by token type
  3. πŸ— Architecture β€” full technical description of all 5 innovations
  4. πŸ“„ Paper & Citation β€” BibTeX, DOI, Zenodo link

The forward pass is implemented in pure NumPy (no PyTorch dependency) so it runs instantly on CPU.

Paper: https://zenodo.org/records/20287390
Code: https://github.com/vignesh2027/TemporalMesh-Transformer

Sign up or log in to comment