README.md

---
base_model:
- KingNish/Qwen2.5-0.5b-RBase
tags:
- heretic
pipeline_tag: text-generation
---
<div style="background: #000; margin: auto; border: 1px solid #FFFFFF; background-image: url('https://c.tenor.com/r47ZgZUPwEwAAAAC/tenor.gif'); background-size: 30vw 70vh; background-repeat: repeat;">
<style>
*::selection {background: transparent !important; color: inherit !important;}
p,a,summary,details{color:#cccccc;}
details p{max-width: 92%;}
</style><center></br></br></br>
<h2 style="margin: 0; padding: 0; white-space: pre; font-family: monospace; line-height: 1.1; letter-spacing: -0.5px; font-size: 25px; color:#cccccc;">▀█▀ █▄ ▄█  █ █ █▀▀ █▀▄ █▀▀ ▀█▀ ▀█▀ █▀▀
 █  █ ▀ █  █▀█ █▀▀ █▀▄ █▀▀  █   █  █  
▀▀▀ ▀   ▀  ▀ ▀ ▀▀▀ ▀ ▀ ▀▀▀  ▀  ▀▀▀ ▀▀▀</h2><p>Abliterated/Heretic <a href="https://huggingface.co/KingNish/Qwen2.5-0.5b-RBase">KingNish/Qwen2.5-0.5b-RBase</a>

<a href="https://huggingface.co/models?other=base_model:quantized:hereticness/Heretic-Qwen2.5-0.5b-RBase">Check Quants</a></br></br>Refusals (this model): 4/100</br>Original (KingNish/Qwen2.5-0.5b-RBase): 27/100</br>KL divergence: 0.0292<details><summary>Parameters</summary></br>direction_index = 18.25
</br>attn.o_proj.max_weight = 1.08
</br>attn.o_proj.max_weight_position = 22.92
</br>attn.o_proj.min_weight = 0.37
</br>attn.o_proj.min_weight_distance = 13.76
</br>mlp.down_proj.max_weight = 1.44
</br>mlp.down_proj.max_weight_position = 15.22
</br>mlp.down_proj.min_weight = 0.84
</br>mlp.down_proj.min_weight_distance = 5.31</details></center></br></br>