Update README.md
Browse files
README.md
CHANGED
|
@@ -96,6 +96,8 @@ text_pred = tokenizer.batch_decode(op, skip_special_tokens=True)[0]
|
|
| 96 |
|
| 97 |
### Training Procedure
|
| 98 |
|
|
|
|
|
|
|
| 99 |
* **LoRA Parameters:** $r=64$, $lora\_alpha=64$, $dropout=0.05$
|
| 100 |
* **Scheduler:** Linear warmup
|
| 101 |
* **Warmup steps:** 20
|
|
|
|
| 96 |
|
| 97 |
### Training Procedure
|
| 98 |
|
| 99 |
+
|
| 100 |
+
|
| 101 |
* **LoRA Parameters:** $r=64$, $lora\_alpha=64$, $dropout=0.05$
|
| 102 |
* **Scheduler:** Linear warmup
|
| 103 |
* **Warmup steps:** 20
|