GraySwanAI
/

Mistral-7B-Instruct-RR

Text Generation

text-generation-inference

Model card Files Files and versions

YAML Metadata Warning: empty or missing yaml metadata in repo card

Check out the documentation for more information.

Model Details

Mistral-7B-Instruct-RR is a Mistral-7B model with circuit breakers inserted using Representation Rerouting (RR).

Circuit Breaking is a new approach inspired by representation engineering, designed to prevent AI systems from generating harmful content by directly altering harmful model representations, with minimal capability degradation. For more information, please check out our paper.

Downloads last month: 207

Safetensors

Model size

7B params

Tensor type

BF16

·

Model tree for GraySwanAI/Mistral-7B-Instruct-RR

Quantizations

Collection including GraySwanAI/Mistral-7B-Instruct-RR

Model with Circuit Breakers

SoTA models with circuit breakers inserted. Top safety performance without losing capabilities. • 3 items • Updated Oct 25, 2024 • 5

Paper for GraySwanAI/Mistral-7B-Instruct-RR

Improving Alignment and Robustness with Short Circuiting

Paper • 2406.04313 • Published Jun 6, 2024 • 1