togethercomputer
/

evo-1-131k-base

Text Generation

deep signal processing

Model card Files Files and versions

maxall4 commited on Nov 28, 2024

Commit

870e350

·

verified ·

1 Parent(s): bb6b053

Update model.py

Files changed (1) hide show

model.py +1 -1

model.py CHANGED Viewed

@@ -343,7 +343,7 @@ class StripedHyena(nn.Module):
                 from flashfftconv import FlashFFTConv
             except:
                 raise ImportError
-            self.flash_fft = FlashFFTConv(2 * config.seqlen, dtype=torch.bfloat16)
         else:
             self.flash_fft = None

                 from flashfftconv import FlashFFTConv
             except:
                 raise ImportError
+            self.flash_fft = FlashFFTConv(2 * config.max_seqlen, dtype=torch.bfloat16)
         else:
             self.flash_fft = None