pretraining-playground/pythia-training-metrics
Updated • 611
AI & ML interests
None defined yet.
rdiehlmartinez
updated a
dataset 10 months ago
rdiehlmartinez
authored 7
papers over 1 year ago
CLIMB: Curriculum Learning for Infant-inspired Model Building
Paper • 2311.08886 • Published
Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing
Paper • 2410.11462 • Published
Attention-based Contextual Language Model Adaptation for Speech Recognition
Paper • 2106.01451 • Published
From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes
Paper • 2410.22906 • Published
Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies
Paper • 2410.22886 • Published • 1
Tending Towards Stability: Convergence Challenges in Small Language Models
Paper • 2410.11451 • Published
Automatically Neutralizing Subjective Bias in Text
Paper • 1911.09709 • Published
rdiehlmartinez
updated 2
datasets over 2 years ago