|
|
--- |
|
|
language: |
|
|
- en |
|
|
license: apache-2.0 |
|
|
tags: |
|
|
- mental-health |
|
|
- therapy |
|
|
- chatbot |
|
|
- text-classification |
|
|
- distilbert |
|
|
pipeline_tag: text-classification |
|
|
library_name: transformers |
|
|
--- |
|
|
|
|
|
# Therapy Chatbot - Mental Health Intent Classification |
|
|
|
|
|
This model classifies mental health-related text into 11 different intent categories. |
|
|
|
|
|
## Model Description |
|
|
|
|
|
- **Model type:** DistilBERT for Sequence Classification |
|
|
- **Language:** English |
|
|
- **Training data:** 3,508 therapy context-response pairs |
|
|
- **Task:** Intent classification for mental health chatbot |
|
|
|
|
|
## Intent Categories |
|
|
|
|
|
The model classifies text into these 11 intents: |
|
|
- `depression` - Feelings of sadness, hopelessness, worthlessness |
|
|
- `anxiety` - Worry, panic, nervousness |
|
|
- `self_esteem` - Issues with self-worth and confidence |
|
|
- `relationship` - Relationship problems and conflicts |
|
|
- `family` - Family-related concerns |
|
|
- `sleep_issues` - Insomnia and sleep problems |
|
|
- `anger` - Anger management issues |
|
|
- `suicide` - Suicidal thoughts (crisis detection) |
|
|
- `trauma` - PTSD and trauma-related issues |
|
|
- `grief` - Loss and bereavement |
|
|
- `general_support` - General emotional support needs |
|
|
|
|
|
## Usage |
|
|
```python |
|
|
from transformers import DistilBertTokenizerFast, DistilBertForSequenceClassification |
|
|
import torch |
|
|
|
|
|
# Load model and tokenizer |
|
|
model = DistilBertForSequenceClassification.from_pretrained("YOUR-USERNAME/therapy-chatbot") |
|
|
tokenizer = DistilBertTokenizerFast.from_pretrained("YOUR-USERNAME/therapy-chatbot") |
|
|
|
|
|
# Make prediction |
|
|
text = "I feel worthless and can't sleep at night" |
|
|
inputs = tokenizer(text, return_tensors="pt", truncation=True, padding=True) |
|
|
|
|
|
with torch.no_grad(): |
|
|
outputs = model(**inputs) |
|
|
|
|
|
prediction = torch.argmax(outputs.logits, dim=1).item() |
|
|
print(f"Predicted intent: {prediction}") |
|
|
``` |
|
|
|
|
|
## Training |
|
|
|
|
|
- **Epochs:** 6 |
|
|
- **Batch size:** 16 |
|
|
- **Learning rate:** 3e-5 |
|
|
- **Validation loss:** ~0.030 |
|
|
|
|
|
## Limitations |
|
|
|
|
|
⚠️ **Important:** This model is NOT a replacement for professional mental health care. It's designed to assist in categorizing user messages for appropriate responses. |
|
|
|
|
|
## Disclaimer |
|
|
|
|
|
This is an AI model for educational and support purposes only. In case of mental health emergencies, please contact: |
|
|
- National Suicide Prevention Lifeline: 988 |
|
|
- Crisis Text Line: Text HOME to 741741 |
