Add training logs and README
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@
|
|
| 10 |
- **use_lora**: `True`
|
| 11 |
- **max_seq_length**: `40000`
|
| 12 |
- **batch_size**: `1`
|
| 13 |
-
- **gradient_accu**: `
|
| 14 |
- **epochs**: `2`
|
| 15 |
- **learning_rate**: `1e-05`
|
| 16 |
- **lora_alpha**: `64`
|
|
|
|
| 10 |
- **use_lora**: `True`
|
| 11 |
- **max_seq_length**: `40000`
|
| 12 |
- **batch_size**: `1`
|
| 13 |
+
- **gradient_accu**: `16`
|
| 14 |
- **epochs**: `2`
|
| 15 |
- **learning_rate**: `1e-05`
|
| 16 |
- **lora_alpha**: `64`
|