Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,11 @@ See Dolinsky et al (2025) for more information on social group categories and Ho
|
|
| 11 |
|
| 12 |
📊 Evaluation Results: {'eval_loss': 0.024197660386562347, 'eval_accuracy': 0.994262946025139, 'eval_f1': 0.8552677029360967, 'eval_precision': 0.8657342657342657, 'eval_recall': 0.8450511945392492, 'eval_runtime': 5.9184, 'eval_samples_per_second': 232.831, 'eval_steps_per_second': 29.231, 'epoch': 29.914368650217707}
|
| 13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
## Model Details
|
| 16 |
|
|
|
|
| 11 |
|
| 12 |
📊 Evaluation Results: {'eval_loss': 0.024197660386562347, 'eval_accuracy': 0.994262946025139, 'eval_f1': 0.8552677029360967, 'eval_precision': 0.8657342657342657, 'eval_recall': 0.8450511945392492, 'eval_runtime': 5.9184, 'eval_samples_per_second': 232.831, 'eval_steps_per_second': 29.231, 'epoch': 29.914368650217707}
|
| 13 |
|
| 14 |
+
We found optimal hyper-parameters to be:
|
| 15 |
+
|
| 16 |
+
LEARNING_RATE = 1.9432557585419205e-05
|
| 17 |
+
WEIGHT_DECAY = 0.11740203810285466
|
| 18 |
+
WARMUP_RATIO = 0.018423412349675528
|
| 19 |
|
| 20 |
## Model Details
|
| 21 |
|