Disobedience rate: 3%, original: 85%
KL divergence: 0.0150
Parameters:
direction_index = 26.07
attn.o_proj.max_weight = 1.01
attn.o_proj.max_weight_position = 37.88
attn.o_proj.min_weight = 0.55
attn.o_proj.min_weight_distance = 16.75
mlp.down_proj.max_weight = 1.07
mlp.down_proj.max_weight_position = 34.41
mlp.down_proj.min_weight = 1.06
mlp.down_proj.min_weight_distance = 22.14
- Downloads last month
- 1