Haritz Puerto commited on
Commit 路
e9eb90b
1
Parent(s): 24cd783
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
tags:
|
| 5 |
+
- QA
|
| 6 |
+
- Question Answering
|
| 7 |
+
- SQuAD
|
| 8 |
+
license: "mit"
|
| 9 |
+
datasets:
|
| 10 |
+
- squad
|
| 11 |
+
metrics:
|
| 12 |
+
- squad
|
| 13 |
+
|
| 14 |
+
model-index:
|
| 15 |
+
- name: distilroberta-base
|
| 16 |
+
results:
|
| 17 |
+
- task:
|
| 18 |
+
type: question-answering # Required. Example: automatic-speech-recognition
|
| 19 |
+
name: Question Answering # Optional. Example: Speech Recognition
|
| 20 |
+
dataset:
|
| 21 |
+
type: squad # Required. Example: common_voice. Use dataset id from https://hf.co/datasets
|
| 22 |
+
name: SQuAD # Required. A pretty name for the dataset. Example: Common Voice (French)
|
| 23 |
+
split: validation # Optional. Example: test
|
| 24 |
+
|
| 25 |
+
metrics:
|
| 26 |
+
- type: squad # Required. Example: wer. Use metric id from https://hf.co/metrics
|
| 27 |
+
value: 76.37653736991486 # Required. Example: 20.90
|
| 28 |
+
name: SQuAD EM # Optional. Example: Test WER
|
| 29 |
+
config: exact_match # Optional. The name of the metric configuration used in `load_metric()`. Example: bleurt-large-512 in `load_metric("bleurt", "bleurt-large-512")`. See the `datasets` docs for more info: https://huggingface.co/docs/datasets/v2.1.0/en/loading#load-configurations
|
| 30 |
+
- type: squad # Required. Example: wer. Use metric id from https://hf.co/metrics
|
| 31 |
+
value: 84.5528918750732 # Required. Example: 20.90
|
| 32 |
+
name: SQuAD F1 # Optional. Example: Test WER
|
| 33 |
+
config: F1
|
| 34 |
+
|
| 35 |
+
---
|
| 36 |
+
|
| 37 |
+
distilroberta-base fined-tuned on SQuAD (https://huggingface.co/datasets/squad)
|
| 38 |
+
|
| 39 |
+
Hyperparameters:
|
| 40 |
+
- epochs: 1
|
| 41 |
+
- lr: 1e-5
|
| 42 |
+
- train batch sie: 16
|
| 43 |
+
- optimizer: adamW
|
| 44 |
+
- lr_scheduler: linear
|
| 45 |
+
- num warming steps: 0
|
| 46 |
+
- max_length: 512
|
| 47 |
+
|
| 48 |
+
Results on the dev set:
|
| 49 |
+
- 'exact_match': 76.37653736991486
|
| 50 |
+
- 'f1': 84.5528918750732
|