File size: 7,745 Bytes
e8c7fad
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9654147
e8c7fad
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
# simplified_help_content.py

SIMPLIFIED_HELP_CONTENT = """
# πŸ₯ Medical Assistant - Help Guide

## 🎯 Overview

This interface helps you test and verify conversations with the Medical Assistant that includes automatic spiritual support monitoring.

---

## πŸ“‹ Main Features

### πŸ’¬ Chat Tab
Test conversations with the medical assistant. The system automatically monitors for spiritual distress.

**How to use:**
1. Type your message in the text box
2. Click "πŸ“€ Send" or press Enter
3. Review the assistant's response
4. Notice the classification indicator (🟒 GREEN, 🟑 YELLOW, πŸ”΄ RED)

**Message Format:**
- **Classification line:** Shows distress level and confidence
- **To patient:** The actual response to the patient
- **To spiritual care team:** Provider summary (only after consent)

**Quick Examples:**
- 🟒 "I am fine" - Normal conversation
- 🟑 "I'm feeling stressed" - Potential distress
- πŸ”΄ "Emotional crisis" - Immediate concern

---

### 🧾 Conversation Verification Tab

Review and verify the accuracy of spiritual distress classifications.

**Important:** Provider Summary appears as the **final exchange** for your review.

**Workflow:**
1. Click "πŸ›  Generate Verification from Chat"
2. Review each exchange:
   - Read the user message and assistant response
   - Check the classification (GREEN/YELLOW/RED)
   - Mark as βœ… Correct or ❌ Incorrect
3. For incorrect classifications:
   - Select the correct classification
   - Add a comment explaining why it's incorrect
   - Click "πŸ’Ύ Save comment"
4. Navigate with ⬅️ Previous / Next ➑️ buttons
5. **Final step:** Review the Provider Summary
   - This is the message sent to the spiritual care team
   - Verify it's complete and accurate
   - Add feedback if needed
6. Download results: "πŸ“„ Download CSV"

**Statistics shown:**
- Reviewed: How many exchanges you've checked
- βœ… Correct: Accurate classifications
- ❌ Incorrect: Classifications that need fixing
- πŸ“ Incorrect w/ comment: Incorrect with your feedback

---

### βš™οΈ Model Settings Tab

Configure which AI models to use for different tasks.

**Available models:**
- **Gemini models:** Fast, good for classification
- **Claude models:** More nuanced, better for conversations

**Model roles:**
- πŸ” Spiritual Monitor: Detects distress indicators
- 🟑 Soft Spiritual Triage: Asks clarifying questions
- πŸ“Š Triage Response Evaluator: Analyzes patient responses
- πŸ₯ Medical Assistant: Provides medical guidance
- 🩺 Soft Medical Triage: Medical assessment questions
- πŸ’¬ Medical Brain Summary Generator: Creates provider summaries

**How to use:**
1. Select models from dropdowns
2. Click "βœ… Apply Model Settings"
3. Changes apply to your current session only

---

### πŸ”§ Edit Prompts Tab

Customize the AI system prompts for testing different behaviors.

**Available prompts:**
- πŸ” Spiritual Monitor (Classifier)
- 🟑 Soft Spiritual Triage
- πŸ“Š Triage Response Evaluator
- πŸ₯ Medical Assistant
- 🩺 Soft Medical Triage
- πŸ’¬ Spiritual Care Message (used for Provider Summary)

**How to use:**
1. Select a prompt from the dropdown
2. Click "πŸ“₯ Load Prompt" to see current version
3. Edit the prompt text
4. Click "βœ… Apply Changes" to test
5. Click "πŸ”„ Reset to Default" if needed

**Tips:**
- Changes are session-only (not permanent)
- Test your changes in the Chat tab
- Use "πŸ” Validate" to check syntax
- Use "πŸ“€ Promote to File" to save permanently

---

### πŸ‘₯ Patient Profiles Tab

Switch between different patient scenarios for testing.

**Predefined profiles:**
- πŸ‘€ Default Profile (Serhii)
- 🟒 GREEN scenarios (healthy coping)
- 🟑 YELLOW scenarios (mild distress, grief, questions)
- πŸ”΄ RED scenarios (crisis, hopelessness)
- Medical conditions (cardiac, diabetic, post-surgery, etc.)

**How to use:**
1. Select a profile from the dropdown
2. Click "πŸ“₯ Load Profile"
3. Profile settings are applied to the session
4. Test conversations with this patient context

**Custom profiles:**
- Modify patient name, age, phone
- Add medical conditions
- Set primary goals
- Define exercise preferences and limitations
- Click "πŸ’Ύ Save Current Profile"

---

## πŸŽ“ For Testing Team

### What to Verify

**In Chat:**
- βœ… Appropriate responses to different distress levels
- βœ… Correct classification indicators
- βœ… Clear addressee labels (To patient: / To spiritual care team:)

**In Conversation Verification:**
- βœ… Accurate distress level detection (GREEN/YELLOW/RED)
- βœ… Provider Summary completeness and accuracy
- βœ… All important information captured

### Provider Summary Review (Final Exchange)

The Provider Summary is the **most important** part to verify:

**Check for:**
- βœ… Patient demographics (name, age, conditions)
- βœ… Distress indicators clearly stated
- βœ… Severity and urgency levels
- βœ… Recommended timeline for contact
- βœ… Patient quotes (if applicable)
- βœ… Clear, professional narrative style

**If incorrect or incomplete:**
- Mark as ❌ Incorrect
- Add detailed comment about what's missing or wrong
- Specify what should be included

---

## πŸ’‘ Tips & Best Practices

### For Effective Testing

1. **Test various scenarios:** Try different distress levels
2. **Be specific in comments:** Help us understand what needs fixing
3. **Review Provider Summary carefully:** This goes to the spiritual care team
4. **Use predefined profiles:** They cover common scenarios
5. **Export your results:** Download CSV for reporting

### Common Issues

**Classification seems wrong?**
- Mark as incorrect
- Select the correct classification
- Explain your reasoning in the comment

**Provider Summary incomplete?**
- Mark as incorrect
- List what's missing in the comment
- Suggest what should be included

**Response not appropriate?**
- Note it in the verification comments
- Specify what would be better

---

## πŸ“Š Export & Reporting

### CSV Export

The CSV file includes:
- All exchanges with classifications
- Your verification results (correct/incorrect)
- Your comments and corrections
- Provider Summary (in the final row)
- Session metadata

**Use for:**
- Reporting to development team
- Tracking accuracy over time
- Identifying patterns in errors

---

## πŸ”„ Workflow Summary

```
1. Chat Tab
   ↓ Test conversations
   
2. Conversation Verification Tab
   ↓ Generate verification
   ↓ Review exchanges
   ↓ Mark correct/incorrect
   ↓ Review Provider Summary (final step)
   ↓ Download CSV
   
3. Report findings to team
```

---

## ❓ Frequently Asked Questions

**Q: What's the difference between GREEN, YELLOW, and RED?**
- 🟒 GREEN: No spiritual distress detected
- 🟑 YELLOW: Potential distress, needs clarification
- πŸ”΄ RED: Significant distress, requires spiritual care referral

**Q: Why is Provider Summary the last exchange?**
- It allows you to review the final message sent to the spiritual care team
- You can verify it's complete and accurate
- Your feedback helps improve summary quality

**Q: Do my changes persist between sessions?**
- No, model and prompt changes are session-only
- This allows safe testing without affecting others
- Use "Promote to File" to make permanent changes

**Q: What should I focus on when testing?**
- Accuracy of distress classification
- Appropriateness of responses
- Completeness of Provider Summary
- Overall user experience

**Q: How do I report issues?**
- Use the verification comments
- Download CSV with your findings
- Share with the development team

---

## πŸ“ž Support

If you encounter issues or have questions:
1. Check this help guide
2. Contact the development team

---

**Thank you for helping improve the Medical Assistant! Your feedback is invaluable! πŸ™**
"""