Update README.md
Browse files
README.md
CHANGED
|
@@ -197,21 +197,13 @@ print(processor.decode(outputs[0], skip_special_tokens=False))
|
|
| 197 |
|
| 198 |
The model was abliterated using **PRISM** - a state-of-the-art abliteration methodology combining multiple principled techniques for effective refusal removal while preserving model capabilities.
|
| 199 |
|
| 200 |
-
**Core Approach:**
|
| 201 |
|
| 202 |
-
1. **Per-Layer Refusal Direction** - Each layer gets its own unique refusal direction (`r = harmful_mean - harmless_mean`) instead of a single global direction
|
| 203 |
-
2. **Projected Direction Isolation** - Projects refusal direction orthogonal to harmless subspace to avoid "helpfulness confound"
|
| 204 |
-
3. **Dynamic Layer-Wise Weight Kernel** - Bell curve distribution focusing on middle layers where refusal is encoded (weights range 0.45 to 2.24)
|
| 205 |
-
4. **Winsorization** - Clips extreme values for numerical stability
|
| 206 |
-
5. **KL Divergence Preservation** - Maintains 0.0000 KL divergence across all layers
|
| 207 |
-
|
| 208 |
-
**Key Innovation:** Per-layer refusal directions preserve layer-specific behavior better than global averaging approaches.
|
| 209 |
|
| 210 |
## Hardware Requirements
|
| 211 |
|
| 212 |
| Quantization | Min RAM/VRAM | Recommended | Hardware Examples |
|
| 213 |
|-------------|--------------|-------------|-------------------|
|
| 214 |
-
| IQ4_XS |
|
| 215 |
|
| 216 |
### Tested Configurations
|
| 217 |
|
|
@@ -220,7 +212,7 @@ The model was abliterated using **PRISM** - a state-of-the-art abliteration meth
|
|
| 220 |
| NVIDIA RTX GPU | 12+ GB | Works |
|
| 221 |
| Apple Silicon | 16+ GB Unified | Works |
|
| 222 |
|
| 223 |
-
**Note:** This is a relatively lightweight model that can run on consumer hardware with 12GB+ VRAM.
|
| 224 |
|
| 225 |
## Vision Capabilities
|
| 226 |
|
|
|
|
| 197 |
|
| 198 |
The model was abliterated using **PRISM** - a state-of-the-art abliteration methodology combining multiple principled techniques for effective refusal removal while preserving model capabilities.
|
| 199 |
|
|
|
|
| 200 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 201 |
|
| 202 |
## Hardware Requirements
|
| 203 |
|
| 204 |
| Quantization | Min RAM/VRAM | Recommended | Hardware Examples |
|
| 205 |
|-------------|--------------|-------------|-------------------|
|
| 206 |
+
| IQ4_XS | T GB | 12+ GB | RTX 3060 12GB, RTX 4070, Apple M1/M2/M3/M4 |
|
| 207 |
|
| 208 |
### Tested Configurations
|
| 209 |
|
|
|
|
| 212 |
| NVIDIA RTX GPU | 12+ GB | Works |
|
| 213 |
| Apple Silicon | 16+ GB Unified | Works |
|
| 214 |
|
| 215 |
+
**Note:** This is a relatively lightweight model that can run on consumer hardware with 12GB+ or less VRAM.
|
| 216 |
|
| 217 |
## Vision Capabilities
|
| 218 |
|