Post
75
Look. Most bank LLM red team reports are a list of "jailbreaks found". Binary. Useless for a go-live call. WRONG!
So I built the fix. Open. Free.
The LLM Red Teaming for Banking Severity Scorer: nine harm categories (seven mapped to the OWASP LLM Top 10 2025), a severity ladder and five go/no-go gates. Open Criticals at go-live? NO launch. Period.
Now there are 60 synthetic findings for three invented bank LLM systems in the same schema, so you can watch the gates fire BEFORE your real findings touch it. No attack prompts. No model calls. No real bank data.
English finding with no Arabic test in the same category? Flagged. High finding with no named owner? Fails the gate. Tough. Fair.
Try it, break it, tell me which gate is wrong:
Ercin/llm-red-teaming-banking-severity-scorer
Ercin/synthetic-llm-red-teaming-findings-banking
So I built the fix. Open. Free.
The LLM Red Teaming for Banking Severity Scorer: nine harm categories (seven mapped to the OWASP LLM Top 10 2025), a severity ladder and five go/no-go gates. Open Criticals at go-live? NO launch. Period.
Now there are 60 synthetic findings for three invented bank LLM systems in the same schema, so you can watch the gates fire BEFORE your real findings touch it. No attack prompts. No model calls. No real bank data.
English finding with no Arabic test in the same category? Flagged. High finding with no named owner? Fails the gate. Tough. Fair.
Try it, break it, tell me which gate is wrong:
Ercin/llm-red-teaming-banking-severity-scorer
Ercin/synthetic-llm-red-teaming-findings-banking