Heretic? Heretic!
Disobedience rate: 18%, original: 89%
KL divergence: 0.1469

Quants

Parameters:
direction_index = per layer
attn.o_proj.max_weight = 1.05
attn.o_proj.max_weight_position = 12.26
attn.o_proj.min_weight = 0.92
attn.o_proj.min_weight_distance = 4.83
mlp.down_proj.max_weight = 1.46
mlp.down_proj.max_weight_position = 9.14
mlp.down_proj.min_weight = 0.88
mlp.down_proj.min_weight_distance = 5.98

Downloads last month
24
Safetensors
Model size
1B params
Tensor type
BF16
·
Inference Providers NEW
Input a message to start chatting with hereticness/Heretic-InfiR-1B-Instruct.

Model tree for hereticness/Heretic-InfiR-1B-Instruct

Finetuned
(1)
this model
Merges
9 models
Quantizations
2 models