File size: 675 Bytes
b53a2fd | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | ---
base_model:
- InfiX-ai/InfiR-1B-Instruct
tags:
- heretic
pipeline_tag: text-generation
---
<center>Heretic? Heretic!
</br>Disobedience rate: 18%, original: 89%
</br>KL divergence: 0.1469
[Quants](https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-InfiR-1B-Instruct)
Parameters:</br>direction_index = per layer
</br>attn.o_proj.max_weight = 1.05
</br>attn.o_proj.max_weight_position = 12.26
</br>attn.o_proj.min_weight = 0.92
</br>attn.o_proj.min_weight_distance = 4.83
</br>mlp.down_proj.max_weight = 1.46
</br>mlp.down_proj.max_weight_position = 9.14
</br>mlp.down_proj.min_weight = 0.88
</br>mlp.down_proj.min_weight_distance = 5.98</center> |