Avey B1 experimental Experimental pre-trained checkpoints for Avey-B1. Not recommended for production use. avey-ai/avey-b1-base-exp Fill-Mask • 0.2B • Updated 1 day ago • 159 avey-ai/avey-b1-large-exp Fill-Mask • 0.4B • Updated 1 day ago • 15 Avey-B Paper • 2602.15814 • Published 2 days ago • 2
Don't Pay Attention All model checkpoints trained for the Don't Pay Attention paper. avey-ai/avey1-dpa-0.1B-100BT Text Generation • 0.2B • Updated Jun 16, 2025 • 1 avey-ai/avey1-dpa-0.1B-95BT Text Generation • 0.2B • Updated Jun 16, 2025 • 1 avey-ai/avey1-dpa-0.1B-90BT Text Generation • 0.2B • Updated Jun 16, 2025 • 1 avey-ai/avey1-dpa-0.5B-100BT Text Generation • 0.5B • Updated Jun 16, 2025 • 1
Avey 1 Research Preview 1.5B preview models trained on 100B tokens of FineWeb, and an instruct-tuned version on smoltalk. avey-ai/avey1-1.5B-base-preview-100BT Text Generation • 2B • Updated Jun 16, 2025 • 13 • 7 avey-ai/avey1-1.5B-it-preview-100BT Text Generation • 2B • Updated Jun 16, 2025 • 2 Don't Pay Attention Paper • 2506.11305 • Published Jun 12, 2025 • 8
Avey B1 experimental Experimental pre-trained checkpoints for Avey-B1. Not recommended for production use. avey-ai/avey-b1-base-exp Fill-Mask • 0.2B • Updated 1 day ago • 159 avey-ai/avey-b1-large-exp Fill-Mask • 0.4B • Updated 1 day ago • 15 Avey-B Paper • 2602.15814 • Published 2 days ago • 2
Avey 1 Research Preview 1.5B preview models trained on 100B tokens of FineWeb, and an instruct-tuned version on smoltalk. avey-ai/avey1-1.5B-base-preview-100BT Text Generation • 2B • Updated Jun 16, 2025 • 13 • 7 avey-ai/avey1-1.5B-it-preview-100BT Text Generation • 2B • Updated Jun 16, 2025 • 2 Don't Pay Attention Paper • 2506.11305 • Published Jun 12, 2025 • 8
Don't Pay Attention All model checkpoints trained for the Don't Pay Attention paper. avey-ai/avey1-dpa-0.1B-100BT Text Generation • 0.2B • Updated Jun 16, 2025 • 1 avey-ai/avey1-dpa-0.1B-95BT Text Generation • 0.2B • Updated Jun 16, 2025 • 1 avey-ai/avey1-dpa-0.1B-90BT Text Generation • 0.2B • Updated Jun 16, 2025 • 1 avey-ai/avey1-dpa-0.5B-100BT Text Generation • 0.5B • Updated Jun 16, 2025 • 1
