--- license: mit base_model: roberta-base tags: - generated_from_trainer metrics: - accuracy model-index: - name: micro_base_help_class_no_pre_seed_1 results: [] --- # micro_base_help_class_no_pre_seed_1 This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.8288 - Accuracy: 0.8506 - F1 Macro: 0.6496 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 16 - eval_batch_size: 16 - seed: 1 - optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-06 - lr_scheduler_type: linear - num_epochs: 10 ### Training results | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro | |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:| | 0.3574 | 1.0 | 313 | 0.3915 | 0.8544 | 0.5436 | | 0.3281 | 2.0 | 626 | 0.3468 | 0.8542 | 0.6399 | | 0.2822 | 3.0 | 939 | 0.4199 | 0.8618 | 0.5364 | | 0.2347 | 4.0 | 1252 | 0.4397 | 0.8552 | 0.6567 | | 0.1707 | 5.0 | 1565 | 0.5268 | 0.8584 | 0.6031 | | 0.0992 | 6.0 | 1878 | 0.8439 | 0.85 | 0.6609 | | 0.0891 | 7.0 | 2191 | 0.8919 | 0.8506 | 0.6486 | | 0.0506 | 8.0 | 2504 | 0.9836 | 0.857 | 0.6425 | | 0.0387 | 9.0 | 2817 | 1.0062 | 0.8536 | 0.6354 | ### Framework versions - Transformers 4.36.2 - Pytorch 2.2.1+cu121 - Datasets 2.19.0 - Tokenizers 0.15.2