How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
Paper • 2604.13977 • Published
None defined yet.
Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks