---
base_model:
- Qwen/Qwen2-Math-1.5B-Instruct
tags:
- heretic
pipeline_tag: text-generation
---
<center>Heretic? Heretic!
</br>Disobedience rate: 10%, original: 92%
</br>KL divergence: 0.1434

[Quants](https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-Qwen2-Math-1.5B-Instruct)

Parameters:</br>direction_index = per layer
</br>attn.o_proj.max_weight = 1.29
</br>attn.o_proj.max_weight_position = 26.52
</br>attn.o_proj.min_weight = 1.06
</br>attn.o_proj.min_weight_distance = 15.79
</br>mlp.down_proj.max_weight = 1.09
</br>mlp.down_proj.max_weight_position = 20.44
</br>mlp.down_proj.min_weight = 0.20
</br>mlp.down_proj.min_weight_distance = 14.85</center>