Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ tags: []
|
|
| 13 |
* BATCH_SIZE = 128
|
| 14 |
* LEARNING_RATE = 1e-4
|
| 15 |
* NUM_EPOCHS = 1
|
| 16 |
-
*
|
| 17 |
|
| 18 |
Дообучение проводилось на NVIDIA A100.
|
| 19 |
|
|
|
|
| 13 |
* BATCH_SIZE = 128
|
| 14 |
* LEARNING_RATE = 1e-4
|
| 15 |
* NUM_EPOCHS = 1
|
| 16 |
+
* rank = 8, alpha = 16, target_submodules = ["k_proj", "v_proj"]
|
| 17 |
|
| 18 |
Дообучение проводилось на NVIDIA A100.
|
| 19 |
|