|
|
--- |
|
|
license: mit |
|
|
datasets: |
|
|
- mrqa |
|
|
language: |
|
|
- en |
|
|
metrics: |
|
|
- squad |
|
|
library_name: adapter-transformers |
|
|
pipeline_tag: question-answering |
|
|
--- |
|
|
|
|
|
# Description |
|
|
This is the MADE encoder model created by Friedman et al. (2021). This encoder should be used along with the following dataset-specific adapters. |
|
|
- https://huggingface.co/UKP-SQuARE/MADE_HotpotQA_Adapter |
|
|
- https://huggingface.co/UKP-SQuARE/MADE_TriviaQA_Adapter |
|
|
- https://huggingface.co/UKP-SQuARE/MADE_SQuAD_Adapter |
|
|
- https://huggingface.co/UKP-SQuARE/MADE_SearchQA_Adapter |
|
|
- https://huggingface.co/UKP-SQuARE/MADE_NewsQA_Adapter |
|
|
- https://huggingface.co/UKP-SQuARE/MADE_NaturalQuestions_Adapter |
|
|
|
|
|
The UKP-SQuARE team created this model repository to simplify the deployment of this model on the UKP-SQuARE platform. The GitHub repository of the original authors is https://github.com/princeton-nlp/MADE |
|
|
|
|
|
|
|
|
|
|
|
# Evaluation Results |
|
|
Friedman et al. (2021) reported the following results: |
|
|
|
|
|
- SQuAD v1.1: 92.4 |
|
|
- HotoptQA: 81.5 |
|
|
- TriviaQA: 80.5 |
|
|
- NewsQA: 72.1 |
|
|
- SearchQA: 85.8 |
|
|
- NaturalQuestions: 80.9 |
|
|
- Avg: 82.2 |
|
|
|
|
|
|
|
|
Please refer to the original publication for more information. |
|
|
|
|
|
# Citation |
|
|
Single-dataset Experts for Multi-dataset Question Answering (Friedman et al., EMNLP 2021) |
