---
title: Transformers Model Architectures
emoji: 📐
colorFrom: indigo
colorTo: blue
sdk: static
pinned: false
license: apache-2.0
---

# 🤗 Transformers — Model Architecture Gallery

Static, dependency-free architecture diagrams for every model in
[`huggingface/transformers`](https://github.com/huggingface/transformers), generated by
introspecting each model built on the `meta` device (no weights, no network).

- **full** view — the decoder/encoder block decomposed top-to-bottom (attention or SSM mixer,
  Q/K/V/O projections with real dims, norms, MLP / Sparse MoE, residual stream, mask grids).
- **diff** view — for models with a `modular_*.py`, what each model overrides / adds / removes
  versus the parent it inherits from.

Open `index.html` for the browsable gallery.