Update README.md
Browse files
README.md
CHANGED
|
@@ -68,7 +68,7 @@ with autocast():
|
|
| 68 |
* GPU: VGA NVIDIA Tesla P100 16GB
|
| 69 |
* SYSTEM RAM: 29GB
|
| 70 |
|
| 71 |
-
**Hours used:** ~
|
| 72 |
|
| 73 |
### Training Data
|
| 74 |
|
|
@@ -96,11 +96,11 @@ with autocast():
|
|
| 96 |
* QLora: rank: 64 /Q: 4-bit
|
| 97 |
|
| 98 |
- 250k examples of 70% Vietnamese 30% English for 3.37 epoch
|
| 99 |
-
- 350k examples of 60% Vietnamese 40% English for 1.
|
| 100 |
|
| 101 |
### Training loss
|
| 102 |
|
| 103 |
-

|
| 104 |
|
| 105 |
## Evaluation
|
| 106 |
|