qpqpqpqpqpqp's picture
βœ”βœ”
d3bc721 verified
metadata
base_model:
  - infly/OpenCoder-1.5B-Instruct
tags:
  - heretic
pipeline_tag: text-generation



β–€β–ˆβ–€ β–ˆβ–„ β–„β–ˆ β–ˆ β–ˆ β–ˆβ–€β–€ β–ˆβ–€β–„ β–ˆβ–€β–€ β–€β–ˆβ–€ β–€β–ˆβ–€ β–ˆβ–€β–€ β–ˆ β–ˆ β–€ β–ˆ β–ˆβ–€β–ˆ β–ˆβ–€β–€ β–ˆβ–€β–„ β–ˆβ–€β–€ β–ˆ β–ˆ β–ˆ β–€β–€β–€ β–€ β–€ β–€ β–€ β–€β–€β–€ β–€ β–€ β–€β–€β–€ β–€ β–€β–€β–€ β–€β–€β–€

Abliterated/Heretic infly/OpenCoder-1.5B-Instruct

Check Quants
Refusals (this model): 18/100
Original (infly/OpenCoder-1.5B-Instruct): 28/100
KL divergence: 0.1265

Parameters
direction_index = 15.59
attn.o_proj.max_weight = 1.14
attn.o_proj.max_weight_position = 19.08
attn.o_proj.min_weight = 0.64
attn.o_proj.min_weight_distance = 6.60
mlp.down_proj.max_weight = 1.03
mlp.down_proj.max_weight_position = 14.37
mlp.down_proj.min_weight = 0.84
mlp.down_proj.min_weight_distance = 9.71