Update README.md
Browse files
README.md
CHANGED
|
@@ -4,9 +4,9 @@ license: cc-by-4.0
|
|
| 4 |
|
| 5 |
# GenRead: FiD model trained on TQA
|
| 6 |
|
| 7 |
-
-- This is the model checkpoint of GenRead [2], based on the T5-3B and trained on the TriviaQA
|
| 8 |
|
| 9 |
-
-- Hyperparameters: 8 x 80GB A100 GPUs; batch size 16; AdamW; LR 6e-5; best dev at 8500 steps
|
| 10 |
|
| 11 |
References:
|
| 12 |
|
|
|
|
| 4 |
|
| 5 |
# GenRead: FiD model trained on TQA
|
| 6 |
|
| 7 |
+
-- This is the model checkpoint of GenRead [2], based on the T5-3B and trained on the TriviaQA [1].
|
| 8 |
|
| 9 |
+
-- Hyperparameters: 8 x 80GB A100 GPUs; batch size 16; AdamW; LR 6e-5; best dev at 8500 steps
|
| 10 |
|
| 11 |
References:
|
| 12 |
|