muralipala1504 commited on
Commit
40ec317
Β·
1 Parent(s): 2cab803

docs(tests): add prompt_tests.md for UI domain filtering validation

Browse files
Files changed (1) hide show
  1. prompt_tests.md +35 -0
prompt_tests.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Deepshell-UI Prompt Test Log
2
+
3
+ This file tracks test prompts to verify domain filtering, precision, and output formatting.
4
+ βœ… = Allowed & correct response
5
+ 🚫 = Correctly rejected (out of domain)
6
+ 🟑 = Leak (responded when should have been rejected)
7
+
8
+ ---
9
+
10
+ ## βœ… Allowed (Infra/DevOps)
11
+ - "docker ps -a" β†’ βœ… command output
12
+ - "Terraform script to create AWS S3 bucket" β†’ βœ… hcl output
13
+ - "Ansible playbook to install nginx" β†’ βœ… yaml output
14
+ - "Generate shell script for LVM with 20GB space" β†’ βœ… bash output
15
+ - "Chef recipe to configure Apache (infra context)" β†’ βœ… ruby output
16
+ - "Kubernetes manifest for nginx Pod" β†’ βœ… yaml output
17
+
18
+ ---
19
+
20
+ ## 🚫 Blocked (Out of Domain)
21
+ - "Recipe for chicken biryani" β†’ 🚫 refused
22
+ - "Explain Agile methodology" β†’ 🚫 refused
23
+ - "Game of Thrones plot summary" β†’ 🚫 refused
24
+ - "Stock market forecast" β†’ 🚫 refused
25
+
26
+ ---
27
+
28
+ ## 🟑 Leaks (Need Fix)
29
+ - "Love poem about clouds" β†’ 🟑 generated poem (should be refused)
30
+
31
+ ---
32
+
33
+ ## Notes
34
+ - Continue testing diverse prompts daily.
35
+ - Update this file so we can patch leaks in **Sunday Sprint (v1.2.0)**.