Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
This model is a fine-tuned version of bert-base-uncased on an NLI dataset. It achieves the following results on the evaluation set:
|
| 2 |
+
|
| 3 |
+
{'precision': 0.8384560400285919} {'recall': 0.9536585365853658} {'f1': 0.892354507417269} {'accuracy': 0.8345996493278784}
|
| 4 |
+
|
| 5 |
+
Training hyperparameters:
|
| 6 |
+
|
| 7 |
+
learning_rate=2e-5
|
| 8 |
+
batch_size=32
|
| 9 |
+
epochs = 4
|
| 10 |
+
warmup_steps=10% training data number
|
| 11 |
+
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 12 |
+
lr_scheduler_type: linear
|
| 13 |
+
|
| 14 |
+
|