| # MTOP (All Birds with One Stone: Multi-task Text Classification for Efficient Inference with One Forward Pass) | |
| **Note:** This project is a work in progress; please stay tuned. | |
| MTOP is a text encoder multi-task method that can conduct one forward pass to | |
| make predictions for all tasks. We propose prompt-based modules tailored for | |
| the multi-task setting and a conditional pooler for flexible task | |
| representations, and initialization from single task models for effective | |
| knowledge transfer. Our proposed approach gets superior performance on news | |
| tasks and the GLUE benchmark. We also release a multi-task news dataset. | |