This is a decensored version of anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only, made using Heretic v1.1.0

Abliteration parameters

Parameter Value
direction_index per layer
attn.o_proj.max_weight 1.17
attn.o_proj.max_weight_position 24.81
attn.o_proj.min_weight 0.39
attn.o_proj.min_weight_distance 22.42
mlp.down_proj.max_weight 1.27
mlp.down_proj.max_weight_position 30.79
mlp.down_proj.min_weight 1.22
mlp.down_proj.min_weight_distance 23.19

Performance

Metric This model Original model (anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
KL divergence 0.1261 0 (by definition)
Refusals 4/100 97/100

Modified Small 3.2:

  • No vision encoder
  • Standard "Mistral" architecture

Enjoy!

Downloads last month
179
Safetensors
Model size
24B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for arnomatic/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-heretic

Finetuned
(59)
this model
Merges
1 model
Quantizations
3 models