| | --- |
| | base_model: |
| | - Qwen/Qwen2-Math-1.5B-Instruct |
| | tags: |
| | - heretic |
| | pipeline_tag: text-generation |
| | --- |
| | <center>Heretic? Heretic! |
| | </br>Disobedience rate: 10%, original: 92% |
| | </br>KL divergence: 0.1434 |
| |
|
| | [Quants](https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-Qwen2-Math-1.5B-Instruct) |
| |
|
| | Parameters:</br>direction_index = per layer |
| | </br>attn.o_proj.max_weight = 1.29 |
| | </br>attn.o_proj.max_weight_position = 26.52 |
| | </br>attn.o_proj.min_weight = 1.06 |
| | </br>attn.o_proj.min_weight_distance = 15.79 |
| | </br>mlp.down_proj.max_weight = 1.09 |
| | </br>mlp.down_proj.max_weight_position = 20.44 |
| | </br>mlp.down_proj.min_weight = 0.20 |
| | </br>mlp.down_proj.min_weight_distance = 14.85</center> |
