| --- |
| library_name: transformers |
| base_model: |
| - allenai/scibert_scivocab_uncased |
| tags: |
| - transformers |
| - pytorch |
| - biomedical |
| - text-classification |
| license: apache-2.0 |
| language: |
| - en |
| pipeline_tag: text-classification |
| --- |
| |
| # scibert_study_conclusion_20251005 |
| |
| Fine-tuned model from the PsyNamic project. |
| |
| ## Base Model |
| |
| `allenai/scibert_scivocab_uncased` |
| |
| ## Task |
| |
| Study Conclusion |
| |
| ## Training Parameters |
| |
| ```json |
| { |
| "mode": "train", |
| "data": "<private_dataset>", |
| "task": "Study Conclusion", |
| "model": "scibert", |
| "cross_val": false, |
| "batch_size": 8, |
| "learning_rate": 5e-05, |
| "weight_decay": 0.01, |
| "lr_scheduler": "linear", |
| "warmup_ratio": 0.1, |
| "epochs": 30, |
| "dropout": 0.1, |
| "early_stopping_patience": 5, |
| "gradient_clipping": 0.1, |
| "device": "cuda", |
| "max_length": 512, |
| "load": null, |
| "outfile": null, |
| "threshold": 0.5, |
| "is_multilabel": false |
| } |
| ``` |
