avey-ai/avey1-dpa-0.1B-100BT
Text Generation • 0.2B • Updated • 4
Don't Pay Attention
All model checkpoints trained for the Don't Pay Attention paper.
-
-
avey-ai/avey1-dpa-0.1B-95BT
Text Generation • 0.2B • Updated • 2 -
avey-ai/avey1-dpa-0.1B-90BT
Text Generation • 0.2B • Updated • 2 -
avey-ai/avey1-dpa-0.5B-100BT
Text Generation • 0.5B • Updated • 4 -
avey-ai/avey1-dpa-0.5B-95BT
0.5B • Updated • 2 -
avey-ai/avey1-dpa-0.5B-90BT
Text Generation • 0.5B • Updated • 3 -
avey-ai/avey1-dpa-1.5B-100BT
Text Generation • 2B • Updated • 3 -
avey-ai/avey1-dpa-1.5B-95BT
Text Generation • 2B • Updated • 2 -
avey-ai/avey1-dpa-1.5B-90BT
Text Generation • 2B • Updated • 3 -
avey-ai/mamba-dpa-0.1B-100BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-0.1B-95BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-0.1B-90BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-0.5B-100BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-0.5B-95BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-0.5B-90BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-1.5B-100BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-1.5B-95BT
Text Generation • Updated • 1 -
avey-ai/mamba-dpa-1.5B-90BT
Text Generation • Updated • 2 -
avey-ai/rwkv7-dpa-0.1B-100BT
Text Generation • 0.2B • Updated • 1 -
avey-ai/rwkv7-dpa-0.1B-95BT
Text Generation • 0.2B • Updated • 1 -
avey-ai/rwkv7-dpa-0.1B-90BT
Text Generation • 0.2B • Updated • 1 -
avey-ai/rwkv7-dpa-0.5B-100BT
Text Generation • 0.5B • Updated • 2 -
avey-ai/rwkv7-dpa-0.5B-95BT
Text Generation • 0.5B • Updated • 2 -
avey-ai/rwkv7-dpa-0.5B-90BT
Text Generation • 0.5B • Updated • 1 -
avey-ai/rwkv7-dpa-1.5B-100BT
Text Generation • 1B • Updated • 1 -
avey-ai/rwkv7-dpa-1.5B-95BT
Text Generation • Updated -
avey-ai/rwkv7-dpa-1.5B-90BT
Text Generation • 1B • Updated • 1 -
avey-ai/tpp-dpa-0.1B-100BT
Text Generation • 0.2B • Updated • 1 -
avey-ai/tpp-dpa-0.1B-95BT
Text Generation • 0.2B • Updated • 1 -
avey-ai/tpp-dpa-0.1B-90BT
Text Generation • 0.2B • Updated • 1 -
avey-ai/tpp-dpa-0.5B-100BT
Text Generation • 0.5B • Updated • 1 -
avey-ai/tpp-dpa-0.5B-95BT
Text Generation • 0.5B • Updated -
avey-ai/tpp-dpa-0.5B-90BT
Text Generation • 0.5B • Updated • 3 -
avey-ai/tpp-dpa-1.5B-100BT
Text Generation • 2B • Updated • 1 -
avey-ai/tpp-dpa-1.5B-95BT
Text Generation • 2B • Updated • 1 -
avey-ai/tpp-dpa-1.5B-90BT
Text Generation • 2B • Updated • 1 -
Don't Pay Attention
Paper • 2506.11305 • Published • 8