metadata
license: apache-2.0
language:
- en
- fr
- de
- es
- it
- pt
- ru
- zh
- ja
base_model:
- mistralai/Mistral-Nemo-Instruct-2407
pipeline_tag: text-generation
library_name: transformers
mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1
MPOA (Magnitude-Preserving Othogonalized Ablation, AKA norm-preserving biprojected abliteration) has been applied the majority of layers in this model, but only to mlp.down_proj.weight layers. Unlike conventional abliteration, self_attn.o_proj.weight layers were left untouched.
Compliance was not maximized for this model. The model appears to be near an edge of chaos with regard to some safety refusals, which should be suitable for varied text completion.
More details to follow.