Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper
• 2406.14491 • Published
• 96
Instruction Pre-Training
-
-
Instruction Synthesizer
🐠86Generate instruction-response pairs from text
-
instruction-pretrain/InstructLM-1.3B
Text Generation • 1B • Updated • 38 • 43 -
instruction-pretrain/InstructLM-500M
Text Generation • 0.6B • Updated • 61 • 36 -
instruction-pretrain/instruction-synthesizer
Text Generation • 7B • Updated • 46 • 79 -
instruction-pretrain/medicine-Llama3-8B
Text Generation • 8B • Updated • 61 • 38 -
instruction-pretrain/finance-Llama3-8B
Text Generation • 8B • Updated • 13.7k • • 75 -
instruction-pretrain/ft-instruction-synthesizer-collection
Viewer • Updated • 249k • 252 • 63