File size: 1,116 Bytes
8234603 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 | ---
license: apache-2.0
library_name: transformers
tags:
- sweep
- fine-tuned
---
# SweepBestModel
This model was selected as the best checkpoint from a hyperparameter sweep over 8 runs. It achieved the highest evaluation accuracy across all configurations tested.
## Model Details
- **Model type:** Encoder-only transformer
- **Training objective:** Sequence classification
- **Sweep strategy:** Bayesian optimization
## Evaluation Results
| Metric | Value |
|---|---|
| eval_accuracy | 0.901 |
| eval_loss | 0.245 |
| f1_score | 0.894 |
| precision | 0.908 |
| recall | 0.881 |
## Training Configuration
The best run was trained with the following hyperparameters:
| Parameter | Value |
|---|---|
| learning_rate | 2e-05 |
| batch_size | 64 |
| epochs | 12 |
| weight_decay | 0.001 |
## Usage
```python
from transformers import AutoModelForSequenceClassification, AutoTokenizer
model = AutoModelForSequenceClassification.from_pretrained("SweepBestModel-TestRepo")
tokenizer = AutoTokenizer.from_pretrained("SweepBestModel-TestRepo")
```
## License
This model is licensed under the Apache-2.0 License.
|