| --- |
| library_name: transformers |
| base_model: allenai/scibert_scivocab_uncased |
| tags: |
| - transformers |
| - pytorch |
| - biomedical |
| - text-classification |
| license: apache-2.0 |
| language: |
| - en |
| pipeline_tag: text-classification |
| --- |
| |
| # scibert_application_form_20250221 |
| |
| Fine-tuned model from the PsyNamic project. |
| |
| ## Base Model |
| |
| `allenai/scibert_scivocab_uncased` |
| |
| ## Task |
| |
| Application Form |
| |
| ## Training Parameters |
| |
| ```json |
| { |
| "mode": "train", |
| "data": "<private_dataset>", |
| "task": "Application Form", |
| "model": "scibert", |
| "cross_val": false, |
| "batch_size": 8, |
| "learning_rate": 5e-05, |
| "weight_decay": 0.01, |
| "lr_scheduler": "linear", |
| "warmup_ratio": 0.1, |
| "epochs": 30, |
| "dropout": 0.1, |
| "early_stopping_patience": 5, |
| "gradient_clipping": 0.1, |
| "device": "cuda", |
| "load": null, |
| "max_length": 512, |
| "is_multilabel": true |
| } |
| ``` |
