BabyLM Sequence Length

community

AI & ML interests

BabyLM 2025 paper submission

Recent Activity

suchirsalhan authored a paper about 1 month ago

BabyLM Turns 4: Call for Papers for the 2026 BabyLM Workshop

suchirsalhan authored a paper 5 months ago

BLiSS 1.0: Evaluating Bilingual Learner Competence in Second Language Small Language Models

suchirsalhan authored a paper 5 months ago

What is the Best Sequence Length for BABYLM?

View all activity

babylm-seqlen 's models 50

babylm-seqlen/opt-256

0.1B • Updated Jun 3, 2025

babylm-seqlen/opt-512

0.1B • Updated Jun 3, 2025

babylm-seqlen/opt-1024

0.1B • Updated Jun 3, 2025

babylm-seqlen/mamba-1024

0.2B • Updated Jun 3, 2025

babylm-seqlen/mamba-512

0.2B • Updated Jun 3, 2025

babylm-seqlen/mamba-256

0.2B • Updated Jun 3, 2025

babylm-seqlen/mamba-128

0.2B • Updated Jun 3, 2025

babylm-seqlen/mamba-64

0.2B • Updated Jun 3, 2025 • 4

babylm-seqlen/opt-128

0.1B • Updated Jun 3, 2025 • 1

babylm-seqlen/opt-64

0.1B • Updated Jun 3, 2025

babylm-seqlen/opt-256-warmup

0.1B • Updated May 31, 2025

babylm-seqlen/opt-128-warmup

0.1B • Updated May 31, 2025 • 1

babylm-seqlen/opt-64-warmup

0.1B • Updated May 31, 2025

babylm-seqlen/opt-512-warmup

0.1B • Updated May 31, 2025

babylm-seqlen/opt-2048-warmup

0.1B • Updated May 31, 2025

babylm-seqlen/opt-4096-warmup

0.1B • Updated May 31, 2025

babylm-seqlen/opt-8192-warmup

0.1B • Updated May 31, 2025

babylm-seqlen/opt-1024-warmup

0.1B • Updated May 31, 2025 • 1

babylm-seqlen/opt-dummy

0.1B • Updated Apr 21, 2025

babylm-seqlen/tokenizer

Updated Apr 7, 2025