thillaic commited on
Commit
6ffb50b
·
verified ·
1 Parent(s): de61ea1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -8
README.md CHANGED
@@ -1,9 +1,65 @@
1
  ---
2
- license: mit
3
- datasets:
4
- - Lumiiree/therapod-dpo
5
- language:
6
- - en
7
- base_model:
8
- - meta-llama/Llama-3.2-3B-Instruct
9
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language: en
3
+ license: apache-2.0
4
+ library_name: transformers
5
+ tags:
6
+ - llama
7
+ - causal-lm
8
+ - merged
9
+ - vllm
10
+ inference:
11
+ parameters:
12
+ max_new_tokens: 256
13
+ temperature: 0.7
14
+ top_p: 0.9
15
+ repetition_penalty: 1.1
16
+ ---
17
+
18
+ # CBT-Copilot 🧠
19
+
20
+ CBT-Copilot is a fine-tuned version of `meta-llama/Llama-3.2-3B-Instruct`, designed to simulate conversations for cognitive behavioral therapy (CBT) support. It has been trained using LoRA and merged into a standalone model.
21
+
22
+ The model is now compatible with `transformers`, `vLLM`, and other inference frameworks.
23
+
24
+ ## 🚀 How to Use (vLLM)
25
+
26
+ You can serve it with [vLLM](https://github.com/vllm-project/vllm):
27
+
28
+ ```bash
29
+ python3 -m vllm.entrypoints.openai.api_server --model your-username/CBT-Copilot
30
+ ```
31
+
32
+ Then query it like this:
33
+
34
+ ```python
35
+ import openai
36
+
37
+ openai.api_key = "EMPTY"
38
+ openai.api_base = "http://localhost:8000/v1"
39
+
40
+ response = openai.ChatCompletion.create(
41
+ model="CBT-Copilot",
42
+ messages=[
43
+ {"role": "user", "content": "I've been feeling really anxious lately. What can I do?"}
44
+ ]
45
+ )
46
+
47
+ print(response["choices"][0]["message"]["content"])
48
+ ```
49
+
50
+ ## 🧠 Intended Use
51
+
52
+ This model is intended for educational and prototyping purposes in mental health-related chatbot systems. It is **not a substitute for professional therapy**.
53
+
54
+ ## 📜 License
55
+
56
+ This model is licensed under the Apache 2.0 license.
57
+
58
+
59
+ ---
60
+
61
+ *Model prepared and fine-tuned by **ThillaiC***
62
+
63
+ ---
64
+
65
+