Heterogeneous Low-Bandwidth Pre-Training of LLMs
Paper • 2601.02360 • Published • 2
Paul Janson
Pauljanson002
·
AI & ML interests
None yet
Recent Activity
upvoted a paper about 1 month ago
Heterogeneous Low-Bandwidth Pre-Training of LLMs upvoted a paper about 1 month ago
A Simple Baseline that Questions the Use of Pretrained-Models in
Continual Learning upvoted a paper about 1 month ago
Overcoming Generic Knowledge Loss with Selective Parameter UpdateOrganizations
None yet
upvoted 3
papers about 1 month ago
authored 6
papers about 1 month ago
Overcoming Generic Knowledge Loss with Selective Parameter Update
Paper • 2308.12462 • Published • 1
Continual Zero-Shot Learning through Semantically Guided Generative Random Walks
Paper • 2308.12366 • Published
A Simple Baseline that Questions the Use of Pretrained-Models in Continual Learning
Paper • 2210.04428 • Published • 2
Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
Paper • 2503.02844 • Published • 1
PyLO: Towards Accessible Learned Optimizers in PyTorch
Paper • 2506.10315 • Published • 2
Heterogeneous Low-Bandwidth Pre-Training of LLMs
Paper • 2601.02360 • Published • 2
upvoted a paper 2 months ago
updated a
bucket 2 months ago
updated a
Space 2 months ago
published a
Space 2 months ago
published a
bucket 2 months ago
liked a
dataset about 1 year ago
updated 2
models about 1 year ago
upvoted a paper over 1 year ago
published 2
models over 1 year ago