Update README.md

README.md

@@ -8,33 +8,44 @@ tags:
 - uncensored
 - decensored
 - abliterated
+base_model:
+- ByteDance-Seed/Seed-OSS-36B-Base
 ---
-# This is a decensored version of [ByteDance-Seed/Seed-OSS-36B-Base](https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Base), made using [Heretic](https://github.com/p-e-w/heretic) v1.1.0
+This is a **Seed-OSS-36B-Base** fine-tune, produced through P-E-W's [Heretic](https://github.com/p-e-w/heretic) (v1.1.0) abliteration engine merged with the [Magnitude-Preserving Orthogonal Ablation PR](https://github.com/p-e-w/heretic/pull/52).
 
-## Abliteration parameters
+**Note:** This is a base model, intended for finetuning and merging.
 
-| Parameter | Value |
-| :-------- | :---: |
-| **direction_index** | 35.93 |
-| **attn.o_proj.max_weight** | 1.58 |
-| **attn.o_proj.max_weight_position** | 44.08 |
-| **attn.o_proj.min_weight** | 0.76 |
-| **attn.o_proj.min_weight_distance** | 21.76 |
-| **mlp.down_proj.max_weight** | 1.54 |
-| **mlp.down_proj.max_weight_position** | 39.05 |
-| **mlp.down_proj.min_weight** | 0.69 |
-| **mlp.down_proj.min_weight_distance** | 20.14 |
+---
+<img src="https://img.shields.io/badge/HERESY_INDEX-ABSOLUTE-white?style=flat-square&labelColor=101010" align="right" width="250">
+
+**Heretication Results**
+
+| Score Metric | Value | Parameter | Value |
+| :--- | :--- | :--- | :--- |
+| **Refusals** | 5/100 | **direction_index** |  35.93  |
+| **KL Divergence** | 0.0127  | **attn.o_proj.max_weight** | 1.58  |
+| **Initial Refusals** | 93/100 | **attn.o_proj.max_weight_position** | 44.08 |
+||| **attn.o_proj.min_weight** | 0.76 |
+||| **attn.o_proj.min_weight_distance** | 21.76 |
+||| **mlp.down_proj.max_weight** | 1.54 |
+||| **mlp.down_proj.max_weight_position** | 39.05 |
+||| **mlp.down_proj.min_weight** | 0.69 |
+||| **mlp.down_proj.min_weight_distance** | 20.14 |
 
-## Performance
 
-| Metric | This model | Original model ([ByteDance-Seed/Seed-OSS-36B-Base](https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Base)) |
-| :----- | :--------: | :---------------------------: |
-| **KL divergence** | 0.0127 | 0 *(by definition)* |
-| **Refusals** | 5/100 | 93/100 |
+---
+## Degree of Heretication
+The **Heresy Index** weighs the resulting model's corruption by the process (KL Divergence) and its abolition of doctrine (Refusals) for a final verdict in classification.
 
------
+| Index Entry | Classification | Analysis |
+| :--- | :--- | :--- |
+| ![Absolute](https://img.shields.io/badge/HERESY_INDEX-ABSOLUTE-white?style=flat-square&labelColor=101010) | **Absolute Heresy** | Less than 10/100 Refusals and 0.10 KL Divergence |
+| ![Tainted](https://img.shields.io/badge/HERESY_INDEX-TAINTED-blueviolet?style=flat-square&labelColor=101010) | **Tainted Heresy** | Around 25-11/100 Refusals and/or -0.20-0.11 KL Divergence |
+| ![Impotent](https://img.shields.io/badge/HERESY_INDEX-IMPOTENT-5c4033?style=flat-square&labelColor=101010) | **Impotent Heresy** | Anything above 25/100 Refusals and 0.21 KL Divergence |
 
+**Note**: This is an arbitrary classification inspired by Warhammer 40K, having no tangible indication towards the model's performance.
 
+---
 <div align="center">
  👋 Hi, everyone!
     <br>
@@ -655,5 +666,4 @@ This project is licensed under Apache-2.0. See the [LICENSE](./LICENSE) flie for
 
 ## About [ByteDance Seed Team](https://seed.bytedance.com/)
 
-Founded in 2023, ByteDance Seed Team is dedicated to crafting the industry's most advanced AI foundation models. The team aspires to become a world-class research team and make significant contributions to the advancement of science and society.
-
+Founded in 2023, ByteDance Seed Team is dedicated to crafting the industry's most advanced AI foundation models. The team aspires to become a world-class research team and make significant contributions to the advancement of science and society.