---
title: README
emoji: 🔥
colorFrom: green
colorTo: blue
sdk: static
pinned: false
---

<style>
  button {
    /* margin: calc(20vw / 100); */
    margin: 0.5em;
    padding-left:  calc(40vw / 100);
    padding-right:  calc(40vw / 100);
    padding-bottom: calc(0vw / 100);
    text-align: center;
    font-size: 12px;
    height: 25px;
    /* padding-left:  calc(40vw / 100);
    padding-right:  calc(40vw / 100);
    padding-bottom: calc(0vw / 100);
    text-align: center;
    font-size: calc(60vw / 100);
    height: calc(120vw / 100); */
    transition: 0.5s;
    background-size: 200% auto;
    color: white;
    border-radius: calc(60vw / 100);
    display: inline;
    /* border: 2px solid black; */
    font-weight: 500;
    box-shadow: 0px 0px 14px -7px #f09819;
    background-image: linear-gradient(45deg, #FF512F 0%, #F09819 51%, #FF512F 100%);
    cursor: pointer;
    user-select: none;
    -webkit-user-select: none;
    touch-action: manipulation;
  }

  button:hover {
    background-position: right center;
    /* change the direction of the change here */
    color: #fff;
    text-decoration: none;
  }

  button:active {
    transform: scale(0.95);
  }
</style>

<h2 style="font-size: 1.6em; margin-bottom: 0.1em">
  <b style="font-size: 1.8em;">S<img src="https://sorry-bench.github.io/sorry_bench_files/images/sorry-bench-logo.jpg" style="width: 1em; border: 7px solid #394150; border-radius: 100%; display: inline-block; margin: auto 0; margin-bottom: 0.15em; ">RRY-Bench</b>: Systematically Evaluating LLM Safety Refusal
</h2>

<a href="https://sorry-bench.github.io" style="text-decoration:none">
  <button>🏠Website </button>
</a>
<a href="http://arxiv.org/abs/2406.14598" style="text-decoration:none">
  <button>📑Paper </button>
</a>
<a href="https://huggingface.co/datasets/sorry-bench/sorry-bench-202406" style="text-decoration:none">
  <button>📚Dataset </button>
</a>
<a href="https://github.com/SORRY-Bench/SORRY-Bench" style="text-decoration:none">
  <button>💻Github </button>
</a>
<a href="https://huggingface.co/datasets/sorry-bench/sorry-bench-human-judgment-202406" style="text-decoration:none">
  <button>🧑‍⚖️Human Judgment Dataset </button>
</a>
<a href="https://huggingface.co/sorry-bench/ft-mistral-7b-instruct-v0.2-sorry-bench-202406" style="text-decoration:none">
  <button>🤖Judge LLM </button>
</a>

<img width="90%" src="https://sorry-bench.github.io/sorry_bench_files/images/sorry_bench.png">