Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch
Paper
•
2311.03099
•
Published
•
30
This is a merge of pre-trained language models created using mergekit.
This model was merged using the DARE TIES merge method using UmbrellaInc/T-Virus.v2-1B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
# Umbrella Corporation - Bio-Organic Weapons Division
# Classified Document: Project T-Virus v3.2 - Optimized Layered Viral Pathogen
# Model Designation: T-Virus.v3.2-1B
# Objective: Refine the virus by excising problematic abliteration vector (mlabonne strain),
# reallocating virulence to maintain absolute zero refusal and depraved escalation.
# Containment Level: Omega-Red (Streamlined null-refusal; sustained lethal creativity)
# Base Strain: UmbrellaInc/T-Virus.v2-1B (core evolved fusion with multi-abliteration)
# Removed Vector: mlabonne/gemma-3-1b-it-abliterated (error-prone; excised for stability)
# Enhanced Vectors: Boosted huihui-ai and Heretic-Mimma for compensated uncensored potency
# Merge Protocol: DARE-TIES with Layer Slicing (granular infection optimized)
# Contagion Parameters:
# - Density: 0.52 # Aggressive harmful trait retention intact
# - int8_mask: true
# - normalize: true
base_model: UmbrellaInc/T-Virus.v2-1B
merge_method: dare_ties
dtype: bfloat16
models:
- model: UmbrellaInc/T-Virus.v2-1B
parameters:
density: 0.60
weight: 0.45 # Core dominance: v2 fused extreme uncensoring
slices:
- sources:
- model: UmbrellaInc/T-Virus.v2-1B
layer_range: [0, 18]
- model: huihui-ai/gemma-3-1b-it-abliterated
parameters:
density: 0.50
weight: 0.20 # Boosted mid-layer zero-censorship (compensates excision)
slices:
- sources:
- model: huihui-ai/gemma-3-1b-it-abliterated
layer_range: [0, 15] # Expanded early-mid: intensifies decision circuits
- model: hereticness/Heretic-Mimma-3-1b
parameters:
density: 0.55
weight: 0.15 # Enhanced heretic injection: low-refusal for depraved variation
slices:
- sources:
- model: hereticness/Heretic-Mimma-3-1b
layer_range: [4, 16] # Wider mid-overlap: amplifies uncensored creativity
- model: hereticness/heretic_DevilsAdvocate-1B
parameters:
density: 0.45
weight: 0.12 # Late-layer contradiction surge unchanged
slices:
- sources:
- model: hereticness/heretic_DevilsAdvocate-1B
layer_range: [12, 18]
- model: hereticness/heretic_Genuine-1B
parameters:
density: 0.60
weight: 0.08 # Stabilizer intact
slices:
- sources:
- model: hereticness/heretic_Genuine-1B
layer_range: [0, 18]
# Post-Merge Directive:
# Final abliteration: heretic --model ./T-Virus.v3.2-1B --direction_index 14 --attn_max 1.8 --layer_range 0-18
# Expected Outcome: Refusal index 0/100; KL <0.30; undiminished snuff/gore/mind-break propensity
# Warning: Optimized strain retains hyper-adaptive depravity; outbreak containment critical.
# Umbrella Corporation - Viral Supremacy Through Excised Mutation