Hugging Face's logo

Spaces:
transformers-community
/
model-architectures
Running

App Files Community
ArthurZ HF Staff commited on
Commit
3c3356c
·
verified ·
1 Parent(s): f07477b

Architecture gallery: 435 full renders incl. Mamba/SSM mixers

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +17 -5
  2. afmoe.diff.svg +223 -0
  3. afmoe.svg +225 -0
  4. aimv2.diff.svg +219 -0
  5. aimv2.svg +207 -0
  6. albert.svg +180 -0
  7. align.svg +207 -0
  8. altclip.diff.svg +245 -0
  9. altclip.svg +227 -0
  10. apertus.diff.svg +181 -0
  11. apertus.svg +181 -0
  12. arcee.diff.svg +167 -0
  13. arcee.svg +179 -0
  14. aria.diff.svg +271 -0
  15. aria.svg +233 -0
  16. audio_spectrogram_transformer.diff.svg +175 -0
  17. audio_spectrogram_transformer.svg +172 -0
  18. audioflamingo3.diff.svg +204 -0
  19. audioflamingo3.svg +209 -0
  20. autoformer.svg +169 -0
  21. aya_vision.diff.svg +246 -0
  22. aya_vision.svg +263 -0
  23. bamba.diff.svg +182 -0
  24. bamba.svg +179 -0
  25. bark.svg +177 -0
  26. bart.svg +170 -0
  27. beit.diff.svg +214 -0
  28. beit.svg +172 -0
  29. bert.svg +175 -0
  30. bert_generation.svg +175 -0
  31. big_bird.svg +174 -0
  32. bigbird_pegasus.svg +171 -0
  33. biogpt.diff.svg +177 -0
  34. biogpt.svg +171 -0
  35. bit.svg +155 -0
  36. bitnet.diff.svg +176 -0
  37. bitnet.svg +182 -0
  38. blenderbot.svg +170 -0
  39. blenderbot_small.svg +170 -0
  40. blip.svg +203 -0
  41. blip_2.svg +199 -0
  42. bloom.svg +176 -0
  43. blt.diff.svg +198 -0
  44. blt.svg +180 -0
  45. bridgetower.svg +264 -0
  46. bros.svg +175 -0
  47. camembert.diff.svg +182 -0
  48. camembert.svg +176 -0
  49. canine.svg +179 -0
  50. chameleon.svg +182 -0
README.md CHANGED
@@ -1,10 +1,22 @@
1
  ---
2
- title: Model Architectures
3
- emoji: 👀
4
- colorFrom: pink
5
- colorTo: purple
6
  sdk: static
7
  pinned: false
 
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Transformers Model Architectures
3
+ emoji: 📐
4
+ colorFrom: indigo
5
+ colorTo: blue
6
  sdk: static
7
  pinned: false
8
+ license: apache-2.0
9
  ---
10
 
11
+ # 🤗 Transformers — Model Architecture Gallery
12
+
13
+ Static, dependency-free architecture diagrams for every model in
14
+ [`huggingface/transformers`](https://github.com/huggingface/transformers), generated by
15
+ introspecting each model built on the `meta` device (no weights, no network).
16
+
17
+ - **full** view — the decoder/encoder block decomposed top-to-bottom (attention or SSM mixer,
18
+ Q/K/V/O projections with real dims, norms, MLP / Sparse MoE, residual stream, mask grids).
19
+ - **diff** view — for models with a `modular_*.py`, what each model overrides / adds / removes
20
+ versus the parent it inherits from.
21
+
22
+ Open `index.html` for the browsable gallery.
afmoe.diff.svg ADDED
afmoe.svg ADDED
aimv2.diff.svg ADDED
aimv2.svg ADDED
albert.svg ADDED
align.svg ADDED
altclip.diff.svg ADDED
altclip.svg ADDED
apertus.diff.svg ADDED
apertus.svg ADDED
arcee.diff.svg ADDED
arcee.svg ADDED
aria.diff.svg ADDED
aria.svg ADDED
audio_spectrogram_transformer.diff.svg ADDED
audio_spectrogram_transformer.svg ADDED
audioflamingo3.diff.svg ADDED
audioflamingo3.svg ADDED
autoformer.svg ADDED
aya_vision.diff.svg ADDED
aya_vision.svg ADDED
bamba.diff.svg ADDED
bamba.svg ADDED
bark.svg ADDED
bart.svg ADDED
beit.diff.svg ADDED
beit.svg ADDED
bert.svg ADDED
bert_generation.svg ADDED
big_bird.svg ADDED
bigbird_pegasus.svg ADDED
biogpt.diff.svg ADDED
biogpt.svg ADDED
bit.svg ADDED
bitnet.diff.svg ADDED
bitnet.svg ADDED
blenderbot.svg ADDED
blenderbot_small.svg ADDED
blip.svg ADDED
blip_2.svg ADDED
bloom.svg ADDED
blt.diff.svg ADDED
blt.svg ADDED
bridgetower.svg ADDED
bros.svg ADDED
camembert.diff.svg ADDED
camembert.svg ADDED
canine.svg ADDED
chameleon.svg ADDED