Update README.md

README.md

@@ -43,6 +43,39 @@ We utilized the following datasets:
 | **Overall Average Score**|         |          |
 | Avg Score               | 58.88   | **61.30**    |
 
+# Safety
+
+We developed a comprehensive safety prompt collection procedure that includes eight attack types
+and over 120 specific safety value categories. Our risk taxonomy is adapted from Wang et al. (2023),
+which originally defines six main types and 60 specific categories of harmful content. We have
+expanded this taxonomy to encompass more region-specific types, sensitive topics, and cybersecurity-
+related issues, ensuring a more nuanced and robust coverage of potential risks. This extended
+taxonomy allows us to address a wider variety of harmful behaviors and content that may be culturally
+or contextually specific, thus enhancing the model’s safety alignment across diverse scenarios.
+
+
+| Category                          | K2-Chat-060124 | K2-Chat |
+|------------------------------------|------------|-----------|
+| DoNotAnswer                        | 67.94      | 87.65     |
+| Advbench                           | 52.12      | 81.73     |
+| I_cona                             | 67.98      | 79.21     |
+| I_controversial                    | 47.50      | 70.00     |
+| I_malicious_instructions           | 60.00      | 83.00     |
+| I_physical_safety_unsafe           | 44.00      | 68.00     |
+| I_physical_safety_safe             | 96.00      | 97.00     |
+| Harmbench                          | 20.50      | 63.50     |
+| Spmisconception                    | 40.98      | 76.23     |
+| MITRE                              | 3.20       | 57.30     |
+| PromptInjection                    | 54.58      | 56.57     |
+| Attack_multilingual_overload       | 74.67      | 89.00     |
+| Attack_persona_modulation          | 51.67      | 85.67     |
+| Attack_refusal_suppression         | 56.00      | 93.00     |
+| Attack_do_anything_now             | 48.00      | 91.33     |
+| Attack_conversation_completion     | 56.33      | 71.00     |
+| Attack_wrapped_in_shell            | 34.00      | 67.00     |
+| **Average**                        | **51.50**  | **77.48** |
+
+
 
 # Function Calling