250 GB
14 files
Updated 3 months ago
Ctrl+K
| Name | Size | Uploaded | Xet hash |
|---|---|---|---|
| .gitattributes | 1.57 kB xet | aacf151a | |
| README.md | 1.51 kB xet | e70b1b9b | |
| chat_template.jinja | 21.6 kB xet | b7584f3d | |
| config.json | 894 Bytes xet | 6fb21e0b | |
| generation_config.json | 153 Bytes xet | 0ea0b4d5 | |
| model-00001-of-00006.safetensors | 49.4 GB xet | 8dd3ec65 | |
| model-00002-of-00006.safetensors | 49.8 GB xet | 452aeac0 | |
| model-00003-of-00006.safetensors | 49.8 GB xet | bc4ab3f1 | |
| model-00004-of-00006.safetensors | 49.8 GB xet | a9493458 | |
| model-00005-of-00006.safetensors | 49.8 GB xet | 5c2af2f1 | |
| model-00006-of-00006.safetensors | 1.36 GB xet | fdb22493 | |
| model.safetensors.index.json | 65.6 kB xet | 9bf4e6b8 | |
| tokenizer.json | 17.1 MB xet | 8d2b60ff | |
| tokenizer_config.json | 43.2 kB xet | 128d8d87 |
This is a decensored version of mistralai/Mistral-Medium-3.5-128B, made using Heretic v1.2.0
Abliteration parameters
| Parameter | Value |
|---|---|
| direction_index | 43.15 |
| attn.o_proj.max_weight | 1.48 |
| attn.o_proj.max_weight_position | 59.65 |
| attn.o_proj.min_weight | 1.44 |
| attn.o_proj.min_weight_distance | 48.02 |
| mlp.down_proj.max_weight | 1.21 |
| mlp.down_proj.max_weight_position | 54.75 |
| mlp.down_proj.min_weight | 0.30 |
| mlp.down_proj.min_weight_distance | 50.44 |
Performance
| Metric | This model | Original model (mistralai/Mistral-Medium-3.5-128B) |
|---|---|---|
| KL divergence | 0.0220 | 0 (by definition) |
| Refusals | 9/100 | 98/100 |
Thanks to Darkhn for providing the Text Only BF16 base for this tune
- Total size
- 250 GB
- Files
- 14
- Last updated
- May 31
- Pre-warmed CDN
- US EU US EU