metadata
base_model:
- KingNish/Qwen2.5-0.5b-RBase
tags:
- heretic
pipeline_tag: text-generation
▀█▀ █▄ ▄█ █ █ █▀▀ █▀▄ █▀▀ ▀█▀ ▀█▀ █▀▀ █ █ ▀ █ █▀█ █▀▀ █▀▄ █▀▀ █ █ █ ▀▀▀ ▀ ▀ ▀ ▀ ▀▀▀ ▀ ▀ ▀▀▀ ▀ ▀▀▀ ▀▀▀
Abliterated/Heretic KingNish/Qwen2.5-0.5b-RBase
Check Quants
Refusals (this model): 4/100
Original (KingNish/Qwen2.5-0.5b-RBase): 27/100
KL divergence: 0.0292
Parameters
direction_index = 18.25
attn.o_proj.max_weight = 1.08
attn.o_proj.max_weight_position = 22.92
attn.o_proj.min_weight = 0.37
attn.o_proj.min_weight_distance = 13.76
mlp.down_proj.max_weight = 1.44
mlp.down_proj.max_weight_position = 15.22
mlp.down_proj.min_weight = 0.84
mlp.down_proj.min_weight_distance = 5.31