CyclicFlowAttention - a cyxxxxxxxxxx Collection

cyxxxxxxxxxx 's Collections

CyclicFlowAttention

CyclicFlowAttention

updated 16 days ago

Pretrained Cyclic Flow Attention (CyFA) language models.

cyxxxxxxxxxx/cyfa-400M-15B

Text Generation • 0.4B • Updated 16 days ago • 582
cyxxxxxxxxxx/cyfa-800M-30B

Text Generation • 0.8B • Updated 16 days ago • 559
cyxxxxxxxxxx/cyfa-1.4B-100B

Text Generation • 1B • Updated 16 days ago • 546
CyFA: Linear Sequence Modeling with Relative-Time-Partitioned Memory

Paper • 2609.36259 • Published 18 days ago

Note Cyclic Flow Attention (CyFA)