metadata
title: Transformers Model Architectures
emoji: 📐
colorFrom: indigo
colorTo: blue
sdk: static
pinned: false
license: apache-2.0
🤗 Transformers — Model Architecture Gallery
Static, dependency-free architecture diagrams for every model in
huggingface/transformers, generated by
introspecting each model built on the meta device (no weights, no network).
- full view — the decoder/encoder block decomposed top-to-bottom (attention or SSM mixer, Q/K/V/O projections with real dims, norms, MLP / Sparse MoE, residual stream, mask grids).
- diff view — for models with a
modular_*.py, what each model overrides / adds / removes versus the parent it inherits from.
Open index.html for the browsable gallery.