Logic Before Language: Pre-pretraining on Formal Derivations Fosters Skill Acquisition and Compressibility
Paper • 2608.03930 • Published • 10
Atsuki Yamaguchi
atsuki-yamaguchi
AI & ML interests
Natural Language Processing
Recent Activity
upvoted a paper about 1 month ago
On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain authored a paper about 1 month ago
How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source DataOrganizations
upvoted a paper 7 days ago
upvoted a paper about 1 month ago
authored 3
papers about 1 month ago
How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
Paper • 2604.13977 • Published
MultiHashFormer: Hash-based Generative Language Models
Paper • 2606.28057 • Published • 22
On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain
Paper • 2607.01444 • Published • 2
published 2
models about 1 month ago
submitted a
paper to Daily Papers about 1 month ago
upvoted a paper about 1 month ago
published 11
models 2 months ago
verify-ppt/smollm3_3b
3B • Updated • 4
verify-ppt/olmo3_3b
3B • Updated • 7
verify-ppt/ppt_3b
3B • Updated • 5
verify-ppt/c4_3b
3B • Updated • 4
verify-ppt/ppt_marin_3b
3B • Updated • 6
verify-ppt/marin_3b
3B • Updated • 5
verify-ppt/ppt_c4_3b
3B • Updated • 4
verify-ppt/ppt-set_c4_3b_v2
3B • Updated • 4
verify-ppt/ppt_marin_3b_v2
3B • Updated • 3
verify-ppt/ppt_c4_3b_v2
3B • Updated • 3
verify-ppt/ppt_olmo3_3b_v2
3B • Updated • 4