DigitalDaimyo
/

AddressedStateAttention

addressed-state-attention

interpretable-ai

mechanistic-interpretability

Model card Files Files and versions

DigitalDaimyo commited on 25 days ago

Commit

63bcaa2

·

verified ·

1 Parent(s): ed347d9

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -1,5 +1,5 @@
 ---
-license: apache-2.0
 tags:
 - pytorch
 - addressed-state-attention
@@ -38,4 +38,4 @@ FineWeb, 187M params: 3.73 val loss / 41.6 PPL (75k steps)
 Architecture: 21 layers, 768d, 12 heads, 16 slots
 Links
 Code: https://github.com/DigitalDaimyo/AddressedStateAttention
-Paper: https://github.com/DigitalDaimyo/AddressedStateAttention/tree/main/paper_drafts

 ---
+license: mit
 tags:
 - pytorch
 - addressed-state-attention
 Architecture: 21 layers, 768d, 12 heads, 16 slots
 Links
 Code: https://github.com/DigitalDaimyo/AddressedStateAttention
+Paper: https://github.com/DigitalDaimyo/AddressedStateAttention/tree/main/paper_drafts