Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,18 @@ tags: []
|
|
| 13 |
|
| 14 |
### Model Description
|
| 15 |
|
| 16 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
|
| 19 |
|
|
|
|
| 13 |
|
| 14 |
### Model Description
|
| 15 |
|
| 16 |
+
MaxLen: 1500
|
| 17 |
+
Dataset: final_dataset_2.json
|
| 18 |
+
batch_size: 4
|
| 19 |
+
num_epochs: 4 (eq. 2)
|
| 20 |
+
checkpoint: 180
|
| 21 |
+
LoRa r = 384
|
| 22 |
+
target_modules = [
|
| 23 |
+
"query_proj", "key_proj", "value_proj", "dense",
|
| 24 |
+
"linear_1", "linear_2",
|
| 25 |
+
"mlp.0", "mlp.2", "mlp.4"
|
| 26 |
+
]
|
| 27 |
+
|
| 28 |
|
| 29 |
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
|
| 30 |
|