metadata
library_name: transformers
base_model: allenai/scibert_scivocab_uncased
tags:
- transformers
- pytorch
- biomedical
- text-classification
license: apache-2.0
language:
- en
pipeline_tag: text-classification
scibert_application_form_20250221
Fine-tuned model from the PsyNamic project.
Base Model
allenai/scibert_scivocab_uncased
Task
Application Form
Training Parameters
{
"mode": "train",
"data": "<private_dataset>",
"task": "Application Form",
"model": "scibert",
"cross_val": false,
"batch_size": 8,
"learning_rate": 5e-05,
"weight_decay": 0.01,
"lr_scheduler": "linear",
"warmup_ratio": 0.1,
"epochs": 30,
"dropout": 0.1,
"early_stopping_patience": 5,
"gradient_clipping": 0.1,
"device": "cuda",
"load": null,
"max_length": 512,
"is_multilabel": true
}