ptran74 commited on
Commit
15a4693
1 Parent(s): 62edd58

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -14,6 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
  This model is a fine-tuned version of [ahotrod/electra_large_discriminator_squad2_512](https://huggingface.co/ahotrod/electra_large_discriminator_squad2_512) on a generated Questions and Answers dataset from the DSPFirst textbook based on the SQuAD 2.0 format.
15
 
16
  # Dataset
 
17
  ```
18
  DatasetDict({
19
  train: Dataset({
@@ -36,7 +37,7 @@ More information needed
36
 
37
  ## Intended uses & limitations
38
 
39
- More information needed
40
 
41
  ## Training and evaluation data
42
 
@@ -57,6 +58,10 @@ The following hyperparameters were used during training:
57
  - lr_scheduler_type: linear
58
  - num_epochs: 4
59
 
 
 
 
 
60
  ### Training results
61
 
62
  | Training Loss | Epoch | Step | Validation Loss |
 
14
  This model is a fine-tuned version of [ahotrod/electra_large_discriminator_squad2_512](https://huggingface.co/ahotrod/electra_large_discriminator_squad2_512) on a generated Questions and Answers dataset from the DSPFirst textbook based on the SQuAD 2.0 format.
15
 
16
  # Dataset
17
+ A visualization of the dataset can be found here: https://github.gatech.edu/pages/VIP-ITS/textbook_SQuAD_explore/explore/textbookv1.0/textbook/
18
  ```
19
  DatasetDict({
20
  train: Dataset({
 
37
 
38
  ## Intended uses & limitations
39
 
40
+ Since the dataset is generated from the DSPFirst textbook, its quality is not guaranteed.
41
 
42
  ## Training and evaluation data
43
 
 
58
  - lr_scheduler_type: linear
59
  - num_epochs: 4
60
 
61
+ ### Model hyperparameters
62
+ - hidden_dropout_prob: 0.5
63
+ - attention_probs_dropout_prob = 0.5
64
+
65
  ### Training results
66
 
67
  | Training Loss | Epoch | Step | Validation Loss |