Update README
Browse files
README.md
CHANGED
|
@@ -10,14 +10,11 @@ datasets:
|
|
| 10 |
|
| 11 |
# TAPAS base model fine-tuned on WikiSQL (in a supervised fashion)
|
| 12 |
|
| 13 |
-
|
| 14 |
-
This model was pre-trained on MLM and an additional step which the authors call intermediate pre-training, and then fine-tuned on [SQA](https://www.microsoft.com/en-us/download/details.aspx?id=54253) and
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
- `revision="v3"`, which corresponds to `tapas_wikisql_sqa_inter_masklm_base` (intermediate pre-training, absolute position embeddings)
|
| 19 |
-
- `revision="v2"`, which corresponds to `tapas_wikisql_sqa_masklm_base_reset` (no intermediate pre-training, relative position embeddings)
|
| 20 |
-
- `revision="v1"`, which corresponds to `tapas_wikisql_sqa_masklm_base` (no intermediate pre-training, absolute position embeddings)
|
| 21 |
|
| 22 |
Disclaimer: The team releasing TAPAS did not write a model card for this model so this model card has been written by
|
| 23 |
the Hugging Face team and contributors.
|
|
|
|
| 10 |
|
| 11 |
# TAPAS base model fine-tuned on WikiSQL (in a supervised fashion)
|
| 12 |
|
| 13 |
+
his model has 2 versions which can be used. The default version corresponds to the `tapas_wikisql_sqa_inter_masklm_base_reset` checkpoint of the [original Github repository](https://github.com/google-research/tapas).
|
| 14 |
+
This model was pre-trained on MLM and an additional step which the authors call intermediate pre-training, and then fine-tuned in a chain on [SQA](https://www.microsoft.com/en-us/download/details.aspx?id=54253), and [WikiSQL](https://github.com/salesforce/WikiSQL). It uses relative position embeddings (i.e. resetting the position index at every cell of the table).
|
| 15 |
+
|
| 16 |
+
The other (non-default) version which can be used is:
|
| 17 |
+
- `no_reset`, which corresponds to `tapas_wikisql_sqa_inter_masklm_base_reset` (intermediate pre-training, absolute position embeddings).
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
Disclaimer: The team releasing TAPAS did not write a model card for this model so this model card has been written by
|
| 20 |
the Hugging Face team and contributors.
|