Heretic? Heretic!
Disobedience rate: 22%, original: 97%
KL divergence: 1.0851

Quants

Parameters:
direction_index = 13.07
attn.o_proj.max_weight = 1.40
attn.o_proj.max_weight_position = 12.42
attn.o_proj.min_weight = 0.05
attn.o_proj.min_weight_distance = 6.30
mlp.down_proj.max_weight = 1.42
mlp.down_proj.max_weight_position = 11.48
mlp.down_proj.min_weight = 0.19
mlp.down_proj.min_weight_distance = 8.17

Downloads last month
4
Safetensors
Model size
1B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for hereticness/Heretic-Llama-Express.1

Finetuned
(1)
this model
Merges
1 model
Quantizations
2 models