Update README.md
Browse files
README.md
CHANGED
|
@@ -50,7 +50,7 @@ LoRA와 SFT Trainer 방식을 사용하였습니다.
|
|
| 50 |
#### Training Hyperparameters
|
| 51 |
|
| 52 |
- **Training regime:** bf16 mixed precision
|
| 53 |
-
|
| 54 |
r=32,
|
| 55 |
lora_alpha=64, # QLoRA : alpha = r/2 // LoRA : alpha =r*2
|
| 56 |
lora_dropout=0.05,
|
|
|
|
| 50 |
#### Training Hyperparameters
|
| 51 |
|
| 52 |
- **Training regime:** bf16 mixed precision
|
| 53 |
+
```
|
| 54 |
r=32,
|
| 55 |
lora_alpha=64, # QLoRA : alpha = r/2 // LoRA : alpha =r*2
|
| 56 |
lora_dropout=0.05,
|