Zayd Muhammad Kawakibi Zuhri's picture

Zayd Muhammad Kawakibi Zuhri PRO

zaydzuhri

·

AI & ML interests

I really like watching loss go down

Recent Activity

updated a dataset 4 days ago

zaydzuhri/single-recall-zoo

published a dataset 4 days ago

zaydzuhri/single-recall-zoo

updated a dataset 5 days ago

zaydzuhri/multi-recall-zoo

View all activity

Organizations

None yet

commented a paper 9 months ago

Predicting the Order of Upcoming Tokens Improves Language Modeling

Paper • 2508.19228 • Published Aug 26, 2025 • 23 •

commented 3 papers about 1 year ago

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

Paper • 2504.20966 • Published Apr 29, 2025 • 31 •

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

Paper • 2504.20966 • Published Apr 29, 2025 • 31 •

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

Paper • 2504.20966 • Published Apr 29, 2025 • 31 •

commented a paper almost 2 years ago

MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding

Paper • 2406.09297 • Published Jun 13, 2024 • 6 •