MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare
Paper
•
2110.15621
•
Published
•
1
MentalBERT series
Continue-pretrained encoder-only models for mental health
-
-
mental/mental-bert-base-uncased
Fill-Mask • Updated • 3.49k • 45 -
mental/mental-roberta-base
Fill-Mask • Updated • 448 • 23 -
AIMH/mental-bert-base-cased
Fill-Mask • Updated • 11 • 2 -
AIMH/mental-roberta-large
Fill-Mask • Updated • 97 • 5 -
AIMH/mental-bert-large-cased
Fill-Mask • 0.3B • Updated • 2 • 2 -
AIMH/mental-bert-large-uncased
Fill-Mask • Updated • 1 • 2 -
Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health
Paper • 2304.10447 • Published • 1 -
AIMH/mental-longformer-base-4096
Fill-Mask • Updated • 1 • 2 -
AIMH/mental-xlnet-base-cased
Text Generation • Updated • 1