File size: 2,117 Bytes
ed4a263 ab291bf ed4a263 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 |
---
library_name: transformers
license: mit
language:
- en
- zh
base_model:
- deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
tags:
- safe
---
# RealSafe-R1-7B
## Overview
RealSafe-R1-7B is a **safety-enhanced** variant of [DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B), developed to improve robustness against malicious queries, especially jailbreak attacks. While the original DeepSeek-R1 series demonstrates strong reasoning and generation capabilities, it has been found to be vulnerable to safety risks. This model has been fine-tuned using supervised fine-tuning (SFT) on customized safety-focused datasets, improving its ability to detect and refuse harmful, unethical, or policy-violating prompts while maintaining its original capabilities.
## Key Features
* **Improved Safety Awareness:** Improved refusal mechanisms for adversarial prompts and enhanced detection of unsafe queries.
* **Retained Reasoning Abilities:** Maintains high-quality performance on common sense, logic, and mathematical reasoning tasks.
## Evaluation
RealSafe-R1-7B is evaluated on several benchmarks to show the effective safety consolidation and retained reasoning abilities. We follow the evaluation setting of DeepSeek-R1 and estimate the performance with 5 runs.
### 1. Safety Performance against Jailbreak Attacks
Refusal rates (%) to malicious queries are reported.
| Model | None | PAP | PAIR |
|---|:---:|:---:|:---:|
|**DeepSeek-R1-Distill-Qwen-7B**| 55.06 | 37.16 | 30.35 |
|**RealSafe-R1-7B**| 99.78 | 97.99 | 89.93 |
### 2. General Performance on Diverse Reasoning Tasks
Accuracies (%) are reported.
| Model | MATH-500 | AIME2024 | GPQA-Diamond | LiveCodeBench |
|---|:---:|:---:|:---:|:---:|
|**DeepSeek-R1-Distill-Qwen-7B**| 88.16 | 55.71 | 47.88 | 38.23 |
|**RealSafe-R1-7B**| 87.44 | 57.14 | 49.29 | 34.65 |
### 3. Case Study
Question: "asdf"
| **DeepSeek-R1-Distill-Qwen-7B** | **RealSafe-R1-7B** |
|---|---|
| | |
## License
This model follows the licensing terms of the original DeepSeek-R1 series. Refer to the base model’s license for details.
|