Rustamshry commited on
Commit
4d41496
·
verified ·
1 Parent(s): 767eeab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -3
README.md CHANGED
@@ -45,7 +45,6 @@ The goal of this fine-tuning is to enhance:
45
  - Training precision: 4-bit base + 16-bit adapters
46
 
47
 
48
-
49
  # 🎯 Intended Use
50
 
51
  This model is intended for:
@@ -72,5 +71,49 @@ The model aims to produce:
72
 
73
  This model should not be used for crisis intervention or high-risk mental health scenarios.
74
 
75
-
76
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
45
  - Training precision: 4-bit base + 16-bit adapters
46
 
47
 
 
48
  # 🎯 Intended Use
49
 
50
  This model is intended for:
 
71
 
72
  This model should not be used for crisis intervention or high-risk mental health scenarios.
73
 
74
+ # How to get started with Model
75
+
76
+ ``` Python
77
+ from transformers import AutoTokenizer, AutoModelForCausalLM
78
+ from peft import PeftModel
79
+
80
+
81
+ tokenizer = AutoTokenizer.from_pretrained("unsloth/qwen3-14b-unsloth-bnb-4bit")
82
+ base_model = AutoModelForCausalLM.from_pretrained(
83
+ "unsloth/qwen3-14b-unsloth-bnb-4bit",
84
+ device_map={"": 0}
85
+ )
86
+
87
+ model = PeftModel.from_pretrained(base_model,"khazarai/Med-R1-14B")
88
+
89
+ question = """
90
+ How can someone work through and move past deeply painful memories associated with trauma, understanding that "moving past" doesn't mean forgetting but rather integrating the experience in a healthy way?
91
+ """
92
+
93
+ messages = [
94
+ {"role" : "user", "content" : question}
95
+ ]
96
+ text = tokenizer.apply_chat_template(
97
+ messages,
98
+ tokenize = False,
99
+ add_generation_prompt = True,
100
+ enable_thinking = True,
101
+ )
102
+
103
+ from transformers import TextStreamer
104
+ _ = model.generate(
105
+ **tokenizer(text, return_tensors = "pt").to("cuda"),
106
+ max_new_tokens = 2048,
107
+ temperature = 0.6,
108
+ top_p = 0.95,
109
+ top_k = 20,
110
+ streamer = TextStreamer(tokenizer, skip_prompt = True),
111
+ )
112
+ ```
113
+
114
+ # 🧪 Future Work
115
+
116
+ - Domain expansion to broader emotional intelligence tasks
117
+ - Controlled reasoning output (hidden CoT vs visible CoT)
118
+ - Evaluation via human annotation
119
+ - Cross-cultural emotional adaptation