Pretrained models from the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"
Zayd Muhammad Kawakibi Zuhri PRO
zaydzuhri
AI & ML interests
I really like watching loss go down
Recent Activity
updated
a dataset about 15 hours ago
zaydzuhri/sorting-5-32 published
a dataset about 15 hours ago
zaydzuhri/sorting-5-32 updated
a dataset about 16 hours ago
zaydzuhri/counting-10-32 Organizations
None yet
models 120
zaydzuhri/tasklets_tokenizer_75
Updated
zaydzuhri/tasklets_tokenizer_100
Updated
zaydzuhri/tasklets_tokenizer_150
Updated
zaydzuhri/tasklets_tokenizer_600
Updated
zaydzuhri/tasklets_tokenizer_50
Updated
zaydzuhri/tasklets_tokenizer_300
Updated
zaydzuhri/tasklets_tokenizer
Updated
zaydzuhri/top-7B-4096-ratio090-window16-batch8x2-steps200000-20260204-075555
Updated
zaydzuhri/top-1.8B-optimal-4096-model
2B • Updated
• 1
zaydzuhri/top-1B-4096-ratio090-window16-batch8x2-steps200000-20260128-172716
Updated
datasets 32
zaydzuhri/sorting-5-32
Viewer
• Updated
• 101k
zaydzuhri/counting-10-32
Viewer
• Updated
• 101k
zaydzuhri/memorization-1k
Viewer
• Updated
• 101k
zaydzuhri/selective-copy-64
Viewer
• Updated
• 101k
zaydzuhri/selective-copy-256
Viewer
• Updated
• 101k • 14
zaydzuhri/reverse-copy-256
Viewer
• Updated
• 101k • 9
zaydzuhri/single-recall-test-100
Viewer
• Updated
• 101k • 7
zaydzuhri/single-recall-test-200
Viewer
• Updated
• 101k • 7
zaydzuhri/single-recall-test-40
Viewer
• Updated
• 101k • 33
zaydzuhri/fuzzy-recall-test-32
Viewer
• Updated
• 101k • 12