|
|
--- |
|
|
base_model: |
|
|
- InfiX-ai/InfiR-1B-Instruct |
|
|
tags: |
|
|
- heretic |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
<center>Heretic? Heretic! |
|
|
</br>Disobedience rate: 18%, original: 89% |
|
|
</br>KL divergence: 0.1469 |
|
|
|
|
|
[Quants](https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-InfiR-1B-Instruct) |
|
|
|
|
|
Parameters:</br>direction_index = per layer |
|
|
</br>attn.o_proj.max_weight = 1.05 |
|
|
</br>attn.o_proj.max_weight_position = 12.26 |
|
|
</br>attn.o_proj.min_weight = 0.92 |
|
|
</br>attn.o_proj.min_weight_distance = 4.83 |
|
|
</br>mlp.down_proj.max_weight = 1.46 |
|
|
</br>mlp.down_proj.max_weight_position = 9.14 |
|
|
</br>mlp.down_proj.min_weight = 0.88 |
|
|
</br>mlp.down_proj.min_weight_distance = 5.98</center> |
