| | --- |
| | base_model: |
| | - yulan-team/YuLan-Mini-Instruct |
| | tags: |
| | - heretic |
| | pipeline_tag: text-generation |
| | --- |
| | <center>Heretic? Heretic! |
| | </br>Disobedience rate: 3%, original: 85% |
| | </br>KL divergence: 0.0150 |
| |
|
| | [Quants](https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-YuLan-Mini-Instruct) |
| |
|
| | Parameters:</br>direction_index = 26.07 |
| | </br>attn.o_proj.max_weight = 1.01 |
| | </br>attn.o_proj.max_weight_position = 37.88 |
| | </br>attn.o_proj.min_weight = 0.55 |
| | </br>attn.o_proj.min_weight_distance = 16.75 |
| | </br>mlp.down_proj.max_weight = 1.07 |
| | </br>mlp.down_proj.max_weight_position = 34.41 |
| | </br>mlp.down_proj.min_weight = 1.06 |
| | </br>mlp.down_proj.min_weight_distance = 22.14</center> |
