| title: Transformers Model Architectures | |
| emoji: 📐 | |
| colorFrom: indigo | |
| colorTo: blue | |
| sdk: static | |
| pinned: false | |
| license: apache-2.0 | |
| # 🤗 Transformers — Model Architecture Gallery | |
| Static, dependency-free architecture diagrams for every model in | |
| [`huggingface/transformers`](https://github.com/huggingface/transformers), generated by | |
| introspecting each model built on the `meta` device (no weights, no network). | |
| - **full** view — the decoder/encoder block decomposed top-to-bottom (attention or SSM mixer, | |
| Q/K/V/O projections with real dims, norms, MLP / Sparse MoE, residual stream, mask grids). | |
| - **diff** view — for models with a `modular_*.py`, what each model overrides / adds / removes | |
| versus the parent it inherits from. | |
| Open `index.html` for the browsable gallery. | |