Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting
Ishaan Watts*, Catherine Li*, Sachin Goyal, Jacob Mitchell Springer, Aditi Raghunathan
Ishaan Watts
WattsIshaan
AI & ML interests
Machine Learning, NLP
Recent Activity
updated a collection about 1 month ago
OLMo-2-1B Midtrained updated a model about 1 month ago
WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamW published a model about 1 month ago
WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamWOrganizations
None yet