Soft Multi-Token Prediction - a JaydenTeoh Collection

JaydenTeoh 's Collections

Soft Multi-Token Prediction

Soft Multi-Token Prediction

updated about 10 hours ago

Pre-trained models from the paper "Multi-Token Prediction Done Right"

Multi-Token Prediction Done Right

Paper • 2610.38331 • Published 3 days ago • 9
JaydenTeoh/ntp-167m-model

Text Generation • 0.2B • Updated about 11 hours ago • 1

Note 167m — next-token baseline
JaydenTeoh/hard-mtp-167m-model

Text Generation • 0.2B • Updated about 11 hours ago • 1

Note 167m — standard MTP
JaydenTeoh/soft-mtp-167m-model

Text Generation • 0.2B • Updated about 11 hours ago

Note 167m — Soft-MTP
JaydenTeoh/ntp-332m-model

Text Generation • 0.3B • Updated about 12 hours ago

Note 332m — next-token baseline
JaydenTeoh/hard-mtp-332m-model

Text Generation • 0.4B • Updated about 12 hours ago

Note 332m — standard MTP
JaydenTeoh/soft-mtp-332m-model

Text Generation • 0.4B • Updated about 11 hours ago

Note 332m — Soft-MTP
JaydenTeoh/ntp-689m-model

Text Generation • 0.7B • Updated about 11 hours ago

Note 689m — next-token baseline
JaydenTeoh/hard-mtp-689m-model

Text Generation • 0.7B • Updated about 11 hours ago

Note 689m — standard MTP
JaydenTeoh/soft-mtp-689m-model

Text Generation • 0.7B • Updated about 11 hours ago

Note 689m — Soft-MTP
JaydenTeoh/ntp-1p2b-model

Text Generation • 1B • Updated about 11 hours ago

Note 1p2b — next-token baseline
JaydenTeoh/hard-mtp-1p2b-model

Text Generation • 1B • Updated about 11 hours ago

Note 1p2b — standard MTP
JaydenTeoh/soft-mtp-1p2b-model

Text Generation • 1B • Updated about 11 hours ago

Note 1p2b — Soft-MTP