TuKoResearch
/

AuriStream7BDeep_7k

AuriStream.AuriStream

Model card Files Files and versions

klemenk commited on May 10

Commit

f3fd4fd

·

verified ·

1 Parent(s): f5c70bf

Update configuration_auristream.py

Files changed (1) hide show

configuration_auristream.py +1 -1

configuration_auristream.py CHANGED Viewed

@@ -14,7 +14,7 @@ class AuriStreamConfig(PretrainedConfig):
         use_rope=True,
         n_pred_steps=20,
         seq_len=4096,
-        skip_connections=False,
         **kwargs
     ):
         self.n_layer = n_layer

         use_rope=True,
         n_pred_steps=20,
         seq_len=4096,
+        skip_connections=True,
         **kwargs
     ):
         self.n_layer = n_layer