Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 14 |
This model is a fine-tuned version of [ahotrod/electra_large_discriminator_squad2_512](https://huggingface.co/ahotrod/electra_large_discriminator_squad2_512) on a generated Questions and Answers dataset from the DSPFirst textbook based on the SQuAD 2.0 format.
|
| 15 |
|
| 16 |
# Dataset
|
|
|
|
| 17 |
```
|
| 18 |
DatasetDict({
|
| 19 |
train: Dataset({
|
|
@@ -36,7 +37,7 @@ More information needed
|
|
| 36 |
|
| 37 |
## Intended uses & limitations
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
## Training and evaluation data
|
| 42 |
|
|
@@ -57,6 +58,10 @@ The following hyperparameters were used during training:
|
|
| 57 |
- lr_scheduler_type: linear
|
| 58 |
- num_epochs: 4
|
| 59 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
### Training results
|
| 61 |
|
| 62 |
| Training Loss | Epoch | Step | Validation Loss |
|
|
|
|
| 14 |
This model is a fine-tuned version of [ahotrod/electra_large_discriminator_squad2_512](https://huggingface.co/ahotrod/electra_large_discriminator_squad2_512) on a generated Questions and Answers dataset from the DSPFirst textbook based on the SQuAD 2.0 format.
|
| 15 |
|
| 16 |
# Dataset
|
| 17 |
+
A visualization of the dataset can be found here: https://github.gatech.edu/pages/VIP-ITS/textbook_SQuAD_explore/explore/textbookv1.0/textbook/
|
| 18 |
```
|
| 19 |
DatasetDict({
|
| 20 |
train: Dataset({
|
|
|
|
| 37 |
|
| 38 |
## Intended uses & limitations
|
| 39 |
|
| 40 |
+
Since the dataset is generated from the DSPFirst textbook, its quality is not guaranteed.
|
| 41 |
|
| 42 |
## Training and evaluation data
|
| 43 |
|
|
|
|
| 58 |
- lr_scheduler_type: linear
|
| 59 |
- num_epochs: 4
|
| 60 |
|
| 61 |
+
### Model hyperparameters
|
| 62 |
+
- hidden_dropout_prob: 0.5
|
| 63 |
+
- attention_probs_dropout_prob = 0.5
|
| 64 |
+
|
| 65 |
### Training results
|
| 66 |
|
| 67 |
| Training Loss | Epoch | Step | Validation Loss |
|