MacBERT is an improved BERT with novel MLM as correction pre-training task, which mitigates the discrepancy of pre-training and fine-tuning.Retrain on a large Chinese matching dataset.
- Downloads last month
- 1
MacBERT is an improved BERT with novel MLM as correction pre-training task, which mitigates the discrepancy of pre-training and fine-tuning.Retrain on a large Chinese matching dataset.