hamingsi
/

SpikingLM

spiking-neural-network

masked-language-modeling

Model card Files Files and versions

hamingsi commited on May 8

Commit

f042b34

·

verified ·

1 Parent(s): bf76c1c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ This checkpoint uses:
 - temporal Spiking BERT with `T=4`
 - LIF nodes for projection, Q, K, V, attention output, and MLP blocks
-- `FP16OptimizedExp2Softmax` through `self.learnmax(attention_scores)` for attention normalization
 ## Files

 - temporal Spiking BERT with `T=4`
 - LIF nodes for projection, Q, K, V, attention output, and MLP blocks
+- `self.learnmax(attention_scores)` for attention normalization
 ## Files