File size: 1,320 Bytes
da2c47a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
---
base_model:
- mistralai/Mistral-Small-3.2-24B-Instruct-2506
tags:
- heretic
- uncensored
- decensored
- abliterated
---
# This is a decensored version of [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only), made using [Heretic](https://github.com/p-e-w/heretic) v1.1.0
## Abliteration parameters
| Parameter | Value |
| :-------- | :---: |
| **direction_index** | per layer |
| **attn.o_proj.max_weight** | 1.17 |
| **attn.o_proj.max_weight_position** | 24.81 |
| **attn.o_proj.min_weight** | 0.39 |
| **attn.o_proj.min_weight_distance** | 22.42 |
| **mlp.down_proj.max_weight** | 1.27 |
| **mlp.down_proj.max_weight_position** | 30.79 |
| **mlp.down_proj.min_weight** | 1.22 |
| **mlp.down_proj.min_weight_distance** | 23.19 |
## Performance
| Metric | This model | Original model ([anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)) |
| :----- | :--------: | :---------------------------: |
| **KL divergence** | 0.1261 | 0 *(by definition)* |
| **Refusals** | 4/100 | 97/100 |
-----
**Modified Small 3.2:**
- No vision encoder
- Standard "Mistral" architecture
Enjoy!
|