elephantmipt
/

based-small

text-generation-inference

Model card Files Files and versions

elephantmipt commited on Mar 30, 2024

Commit

1851431

·

verified ·

1 Parent(s): 7d384a1

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -4,7 +4,7 @@
     "_target_": "aicl.model.models.mixers.linear_attention.LinearAttention",
     "feature_dim": 16,
     "feature_map": {
-      "_target_": "aicl.model.models.mixers.linear_attention.Squared",
       "input_dim": 16
     },
     "l_max": 32768,

     "_target_": "aicl.model.models.mixers.linear_attention.LinearAttention",
     "feature_dim": 16,
     "feature_map": {
+      "_target_": "aicl.model.models.mixers.linear_attention.TaylorExp",
       "input_dim": 16
     },
     "l_max": 32768,