Update README.md
Browse files
README.md
CHANGED
|
@@ -92,7 +92,7 @@ For hyperparameters used in each stage, please refer to the following table:
|
|
| 92 |
|
| 93 |
| **Hyperparameter** | **Phase 1** | **Phase 2** | **Phase 3** |
|
| 94 |
| --- | --- | --- | --- |
|
| 95 |
-
| LR Warmup Steps| 86 | 86 |
|
| 96 |
| LR Start Value | 0.012 | 0.0087825 | 0.002 |
|
| 97 |
| LR Final Value | 0.00012408 | 0.00013679 | 0.0002 |
|
| 98 |
| LR Decay | Linear | Linear | Linear |
|
|
|
|
| 92 |
|
| 93 |
| **Hyperparameter** | **Phase 1** | **Phase 2** | **Phase 3** |
|
| 94 |
| --- | --- | --- | --- |
|
| 95 |
+
| LR Warmup Steps| 86 | 86 | 276 |
|
| 96 |
| LR Start Value | 0.012 | 0.0087825 | 0.002 |
|
| 97 |
| LR Final Value | 0.00012408 | 0.00013679 | 0.0002 |
|
| 98 |
| LR Decay | Linear | Linear | Linear |
|