ptran74 commited on
Commit
b9a188c
1 Parent(s): f3ae04b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -11,6 +11,14 @@ model-index:
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
  should probably proofread and complete it, then remove this comment. -->
13
 
 
 
 
 
 
 
 
 
14
  # DSPFirst-Finetuning-5
15
 
16
  This model is a fine-tuned version of [ahotrod/electra_large_discriminator_squad2_512](https://huggingface.co/ahotrod/electra_large_discriminator_squad2_512) on a generated Questions and Answers dataset from the DSPFirst textbook based on the SQuAD 2.0 format.<br />
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
  should probably proofread and complete it, then remove this comment. -->
13
 
14
+ # Important Note:
15
+ `load_best_model_at_end` is not working properly. I created the `combined` metric (55% F1 score + 45% exact match score) to rank the best result but it still does not work. Here is the setting in the `TrainingArguments`:
16
+ ```
17
+ load_best_model_at_end=True,
18
+ metric_for_best_model='combined',
19
+ greater_is_better=True,
20
+ ```
21
+
22
  # DSPFirst-Finetuning-5
23
 
24
  This model is a fine-tuned version of [ahotrod/electra_large_discriminator_squad2_512](https://huggingface.co/ahotrod/electra_large_discriminator_squad2_512) on a generated Questions and Answers dataset from the DSPFirst textbook based on the SQuAD 2.0 format.<br />