deepshell / prompt_tests.md
muralipala1504
docs(tests): add prompt_tests.md for UI domain filtering validation
40ec317
|
Raw
History Blame Contribute Delete
1.12 kB
# Deepshell-UI Prompt Test Log
This file tracks test prompts to verify domain filtering, precision, and output formatting.
βœ… = Allowed & correct response
🚫 = Correctly rejected (out of domain)
🟑 = Leak (responded when should have been rejected)
---
## βœ… Allowed (Infra/DevOps)
- "docker ps -a" β†’ βœ… command output
- "Terraform script to create AWS S3 bucket" β†’ βœ… hcl output
- "Ansible playbook to install nginx" β†’ βœ… yaml output
- "Generate shell script for LVM with 20GB space" β†’ βœ… bash output
- "Chef recipe to configure Apache (infra context)" β†’ βœ… ruby output
- "Kubernetes manifest for nginx Pod" β†’ βœ… yaml output
---
## 🚫 Blocked (Out of Domain)
- "Recipe for chicken biryani" β†’ 🚫 refused
- "Explain Agile methodology" β†’ 🚫 refused
- "Game of Thrones plot summary" β†’ 🚫 refused
- "Stock market forecast" β†’ 🚫 refused
---
## 🟑 Leaks (Need Fix)
- "Love poem about clouds" β†’ 🟑 generated poem (should be refused)
---
## Notes
- Continue testing diverse prompts daily.
- Update this file so we can patch leaks in **Sunday Sprint (v1.2.0)**.