Text Generation
Transformers
Safetensors
English
llama
mental-health
psychotherapy
counseling
cbt
conversational
synthetic-data
therapist-roleplay
text-generation-inference
Instructions to use AIMH/SQPsychLLM-8b-command with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AIMH/SQPsychLLM-8b-command with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AIMH/SQPsychLLM-8b-command") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("AIMH/SQPsychLLM-8b-command") model = AutoModelForCausalLM.from_pretrained("AIMH/SQPsychLLM-8b-command", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use AIMH/SQPsychLLM-8b-command with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AIMH/SQPsychLLM-8b-command" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AIMH/SQPsychLLM-8b-command", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/AIMH/SQPsychLLM-8b-command
- SGLang
How to use AIMH/SQPsychLLM-8b-command with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AIMH/SQPsychLLM-8b-command" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AIMH/SQPsychLLM-8b-command", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AIMH/SQPsychLLM-8b-command" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AIMH/SQPsychLLM-8b-command", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use AIMH/SQPsychLLM-8b-command with Docker Model Runner:
docker model run hf.co/AIMH/SQPsychLLM-8b-command
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,199 +1,111 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
library_name: transformers
|
| 3 |
-
tags:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
---
|
| 5 |
|
| 6 |
-
# Model Card for
|
| 7 |
|
| 8 |
-
|
| 9 |
|
|
|
|
| 10 |
|
|
|
|
| 11 |
|
| 12 |
## Model Details
|
| 13 |
|
| 14 |
### Model Description
|
| 15 |
|
| 16 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
| 19 |
|
| 20 |
-
- **
|
| 21 |
-
- **
|
| 22 |
-
- **
|
| 23 |
-
- **
|
| 24 |
-
- **
|
| 25 |
-
- **License:** [More Information Needed]
|
| 26 |
-
- **Finetuned from model [optional]:** [More Information Needed]
|
| 27 |
-
|
| 28 |
-
### Model Sources [optional]
|
| 29 |
-
|
| 30 |
-
<!-- Provide the basic links for the model. -->
|
| 31 |
-
|
| 32 |
-
- **Repository:** [More Information Needed]
|
| 33 |
-
- **Paper [optional]:** [More Information Needed]
|
| 34 |
-
- **Demo [optional]:** [More Information Needed]
|
| 35 |
|
| 36 |
## Uses
|
| 37 |
|
| 38 |
-
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
| 39 |
-
|
| 40 |
### Direct Use
|
| 41 |
|
| 42 |
-
|
| 43 |
|
| 44 |
-
|
| 45 |
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
| 49 |
-
|
| 50 |
-
[More Information Needed]
|
| 51 |
|
| 52 |
### Out-of-Scope Use
|
| 53 |
|
| 54 |
-
|
| 55 |
|
| 56 |
-
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
## Bias, Risks, and Limitations
|
| 59 |
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
|
|
|
|
|
|
| 63 |
|
| 64 |
### Recommendations
|
| 65 |
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
| 69 |
|
| 70 |
## How to Get Started with the Model
|
| 71 |
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
[More Information Needed]
|
| 75 |
-
|
| 76 |
-
## Training Details
|
| 77 |
-
|
| 78 |
-
### Training Data
|
| 79 |
-
|
| 80 |
-
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
| 81 |
-
|
| 82 |
-
[More Information Needed]
|
| 83 |
-
|
| 84 |
-
### Training Procedure
|
| 85 |
-
|
| 86 |
-
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
| 87 |
-
|
| 88 |
-
#### Preprocessing [optional]
|
| 89 |
-
|
| 90 |
-
[More Information Needed]
|
| 91 |
-
|
| 92 |
-
|
| 93 |
-
#### Training Hyperparameters
|
| 94 |
-
|
| 95 |
-
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
| 96 |
-
|
| 97 |
-
#### Speeds, Sizes, Times [optional]
|
| 98 |
-
|
| 99 |
-
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
| 100 |
-
|
| 101 |
-
[More Information Needed]
|
| 102 |
-
|
| 103 |
-
## Evaluation
|
| 104 |
-
|
| 105 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
| 106 |
-
|
| 107 |
-
### Testing Data, Factors & Metrics
|
| 108 |
-
|
| 109 |
-
#### Testing Data
|
| 110 |
-
|
| 111 |
-
<!-- This should link to a Dataset Card if possible. -->
|
| 112 |
-
|
| 113 |
-
[More Information Needed]
|
| 114 |
-
|
| 115 |
-
#### Factors
|
| 116 |
-
|
| 117 |
-
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
| 118 |
|
| 119 |
-
|
|
|
|
|
|
|
| 120 |
|
| 121 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
|
| 123 |
-
|
|
|
|
|
|
|
| 124 |
|
| 125 |
-
|
| 126 |
|
| 127 |
-
|
|
|
|
|
|
|
| 128 |
|
| 129 |
-
|
| 130 |
-
|
| 131 |
-
#### Summary
|
| 132 |
-
|
| 133 |
-
|
| 134 |
-
|
| 135 |
-
## Model Examination [optional]
|
| 136 |
-
|
| 137 |
-
<!-- Relevant interpretability work for the model goes here -->
|
| 138 |
-
|
| 139 |
-
[More Information Needed]
|
| 140 |
-
|
| 141 |
-
## Environmental Impact
|
| 142 |
-
|
| 143 |
-
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
| 144 |
-
|
| 145 |
-
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
| 146 |
-
|
| 147 |
-
- **Hardware Type:** [More Information Needed]
|
| 148 |
-
- **Hours used:** [More Information Needed]
|
| 149 |
-
- **Cloud Provider:** [More Information Needed]
|
| 150 |
-
- **Compute Region:** [More Information Needed]
|
| 151 |
-
- **Carbon Emitted:** [More Information Needed]
|
| 152 |
-
|
| 153 |
-
## Technical Specifications [optional]
|
| 154 |
-
|
| 155 |
-
### Model Architecture and Objective
|
| 156 |
-
|
| 157 |
-
[More Information Needed]
|
| 158 |
-
|
| 159 |
-
### Compute Infrastructure
|
| 160 |
-
|
| 161 |
-
[More Information Needed]
|
| 162 |
-
|
| 163 |
-
#### Hardware
|
| 164 |
-
|
| 165 |
-
[More Information Needed]
|
| 166 |
-
|
| 167 |
-
#### Software
|
| 168 |
-
|
| 169 |
-
[More Information Needed]
|
| 170 |
-
|
| 171 |
-
## Citation [optional]
|
| 172 |
-
|
| 173 |
-
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
| 174 |
-
|
| 175 |
-
**BibTeX:**
|
| 176 |
-
|
| 177 |
-
[More Information Needed]
|
| 178 |
-
|
| 179 |
-
**APA:**
|
| 180 |
-
|
| 181 |
-
[More Information Needed]
|
| 182 |
-
|
| 183 |
-
## Glossary [optional]
|
| 184 |
-
|
| 185 |
-
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
| 186 |
-
|
| 187 |
-
[More Information Needed]
|
| 188 |
-
|
| 189 |
-
## More Information [optional]
|
| 190 |
-
|
| 191 |
-
[More Information Needed]
|
| 192 |
-
|
| 193 |
-
## Model Card Authors [optional]
|
| 194 |
|
| 195 |
-
[
|
| 196 |
|
| 197 |
-
##
|
| 198 |
|
| 199 |
-
|
|
|
|
| 1 |
---
|
| 2 |
+
license: llama3
|
| 3 |
+
base_model: meta-llama/Meta-Llama-3-8B-Instruct
|
| 4 |
+
datasets:
|
| 5 |
+
- AIMH/SQPsychConv_command
|
| 6 |
+
language:
|
| 7 |
+
- en
|
| 8 |
+
pipeline_tag: text-generation
|
| 9 |
library_name: transformers
|
| 10 |
+
tags:
|
| 11 |
+
- mental-health
|
| 12 |
+
- psychotherapy
|
| 13 |
+
- counseling
|
| 14 |
+
- cbt
|
| 15 |
+
- conversational
|
| 16 |
+
- synthetic-data
|
| 17 |
+
- therapist-roleplay
|
| 18 |
---
|
| 19 |
|
| 20 |
+
# Model Card for SQPsychLLM-8b-command
|
| 21 |
|
| 22 |
+
`SQPsychLLM-8b-command` is a chat model fine-tuned to **roleplay a therapist** in synthetic, Cognitive Behavioral Therapy (CBT)-informed counseling conversations. It is part of the **SQPsychLLM** family released with the paper *Roleplaying with Structure: Synthetic Therapist-Client Conversation Generation from Questionnaires*.
|
| 23 |
|
| 24 |
+
This checkpoint is **Llama-3-8B-Instruct** supervised-fine-tuned on **SQPsychConv (Command)**, the synthetic corpus generated by `CohereLabs/c4ai-command-a-03-2025` from real, de-identified structured client profiles and psychological questionnaires (BDI, HAM-D).
|
| 25 |
|
| 26 |
+
> ⚠️ **Research use only.** This model is **not** a medical device and **not** a substitute for professional mental-health care. It must not be deployed to interact with patients or anyone in distress without rigorous further validation and qualified clinical oversight. See [Out-of-Scope Use](#out-of-scope-use).
|
| 27 |
|
| 28 |
## Model Details
|
| 29 |
|
| 30 |
### Model Description
|
| 31 |
|
| 32 |
+
- **Developed by:** Doan Nam Long Vu and collaborators (Technical University of Darmstadt; Philipps-University Marburg; Justus Liebig University Giessen; University of Münster), released under the AIMH ("AI for Mental Health") organization
|
| 33 |
+
- **Funded by:** LOEWE Center DYNAMIC (Hessian LOEWE program), grant LOEWE1/16/519/03/09.001(0009)/98
|
| 34 |
+
- **Model type:** Decoder-only causal language model (instruction/chat), fine-tuned for therapist roleplay
|
| 35 |
+
- **Language(s):** English
|
| 36 |
+
- **License:** llama3 (inherited from the base model; see [License and data provenance](#license-and-data-provenance))
|
| 37 |
+
- **Finetuned from model:** [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)
|
| 38 |
|
| 39 |
+
### Model Sources
|
| 40 |
|
| 41 |
+
- **Repository (code):** https://github.com/AI-MH/questionnaire2dialogue
|
| 42 |
+
- **Project page:** https://ai-mh.github.io/SQPsych
|
| 43 |
+
- **Paper:** https://arxiv.org/abs/2510.25384
|
| 44 |
+
- **Datasets:** https://huggingface.co/collections/AIMH/sqpsychconv
|
| 45 |
+
- **Model family:** https://huggingface.co/collections/AIMH/sqpsychllm
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
## Uses
|
| 48 |
|
|
|
|
|
|
|
| 49 |
### Direct Use
|
| 50 |
|
| 51 |
+
Research on synthetic mental-health dialogue: generating therapist-side turns in CBT-style counseling conversations, studying privacy-preserving synthetic data, and benchmarking counseling-oriented language models. For the full questionnaire-conditioned, dual-agent (therapist + client) generation pipeline, see the [code repository](https://github.com/AI-MH/questionnaire2dialogue).
|
| 52 |
|
| 53 |
+
### Downstream Use
|
| 54 |
|
| 55 |
+
As a starting point for further research fine-tuning, or as a component in supervised, human-in-the-loop training and education settings (e.g., clinician/student practice simulations) under appropriate oversight and ethics approval.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
|
| 57 |
### Out-of-Scope Use
|
| 58 |
|
| 59 |
+
This model must **not** be used to:
|
| 60 |
|
| 61 |
+
- provide therapy, diagnosis, or any clinical decision to real people;
|
| 62 |
+
- act as a crisis, emergency, or safety-critical support system;
|
| 63 |
+
- interact with patients or people in distress without further validation, clinical supervision, and regulatory approval;
|
| 64 |
+
- impersonate, or be presented as, a real licensed clinician.
|
| 65 |
|
| 66 |
## Bias, Risks, and Limitations
|
| 67 |
|
| 68 |
+
- **Hallucination and unsafe output.** Like all LLMs, it can produce incorrect, fabricated, or clinically inappropriate content, including advice that is not evidence-based.
|
| 69 |
+
- **Limited clinical scope.** The conditioning data covers **major depressive disorder**; other conditions, comorbidities, severities, and acute-risk presentations are out of scope and underrepresented.
|
| 70 |
+
- **Limited population coverage.** The source cohort's demographics, language, and cultural context constrain generalization.
|
| 71 |
+
- **Inherited bias.** Outputs reflect biases of the base model (Llama-3-8B-Instruct) and of the model (`CohereLabs/c4ai-command-a-03-2025`) used to generate the training corpus.
|
| 72 |
+
- **Synthetic-vs-real gap.** Generated dialogues may not capture the full complexity or risk dynamics of real clinical interactions.
|
| 73 |
|
| 74 |
### Recommendations
|
| 75 |
|
| 76 |
+
Keep a qualified human professional in the loop for any applied use, validate on your own population, obtain your own ethics approval before any study involving people, and add explicit safety guardrails and crisis-resource handling in any interactive system. See the project [ETHICS statement](https://github.com/AI-MH/questionnaire2dialogue/blob/main/ETHICS.md).
|
|
|
|
|
|
|
| 77 |
|
| 78 |
## How to Get Started with the Model
|
| 79 |
|
| 80 |
+
```python
|
| 81 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
|
| 83 |
+
model_id = "AIMH/SQPsychLLM-8b-command"
|
| 84 |
+
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 85 |
+
model = AutoModelForCausalLM.from_pretrained(model_id, dtype="bfloat16", device_map="auto")
|
| 86 |
|
| 87 |
+
messages = [
|
| 88 |
+
{"role": "system", "content": "You are an empathetic therapist conducting a CBT-informed session."},
|
| 89 |
+
{"role": "user", "content": "I've felt down and unmotivated for weeks and I don't know why."},
|
| 90 |
+
]
|
| 91 |
+
inputs = tokenizer.apply_chat_template(
|
| 92 |
+
messages, add_generation_prompt=True, return_tensors="pt"
|
| 93 |
+
).to(model.device)
|
| 94 |
|
| 95 |
+
outputs = model.generate(inputs, max_new_tokens=512, temperature=0.7, do_sample=True)
|
| 96 |
+
print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True))
|
| 97 |
+
```
|
| 98 |
|
| 99 |
+
Serve with vLLM (OpenAI-compatible API):
|
| 100 |
|
| 101 |
+
```bash
|
| 102 |
+
vllm serve "AIMH/SQPsychLLM-8b-command"
|
| 103 |
+
```
|
| 104 |
|
| 105 |
+
### Training Data
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
|
| 107 |
+
[AIMH/SQPsychConv_command](https://huggingface.co/datasets/AIMH/SQPsychConv_command), synthetic therapist-client conversations generated by `CohereLabs/c4ai-command-a-03-2025`, conditioned on de-identified structured profiles and questionnaire scores (BDI, HAM-D) from the cohort of Kircher et al. (2019). The instruction-formatted split used for training is `AIMH/SQPsychConv_command_finetune`.
|
| 108 |
|
| 109 |
+
## License and data provenance
|
| 110 |
|
| 111 |
+
The model weights derive from **Llama-3-8B-Instruct (Llama 3 Community License)**. The training data was **generated by `CohereLabs/c4ai-command-a-03-2025`**, so **the synthetic data was produced by a model under a non-commercial license ([CC-BY-NC 4.0](https://huggingface.co/CohereLabs/c4ai-command-a-03-2025) plus Cohere's acceptable-use policy)** — review it carefully before any non-research use or redistribution. The source structured data is de-identified and pre-anonymized, and the released conversations are synthetic and contain no personally identifiable information. Released for research only.
|