L3-Aethora-15B
The Skullery Presents L3-Aethora-15B.
Creator: Steelskull
Dataset: Aether-Lite-V1.2
About L3-Aethora-15B:
L3-Aethora-15B was crafted through using the abilteration method to adjust model responses. The model's refusal is inhibited, focusing on yielding more compliant and facilitative dialogue interactions. It underwent a specialized merging process (originally used by @Elias) by using passthrough merge to create a 15b model, with specific adjustments to 'o_proj' and 'down_proj' settings, enhancing its efficiency and reducing perplexity. This created AbL3In-15b.
AbL3In-15b was then fine-tuned on the Aether-Lite-V1 dataset, containing ~82000 high quality samples, designed to strike a fine balance between creativity, slop, and intelligence at about a 60/40 split
Filtered Phrases: GPTslop, Claudism's
Dataset Summary: (Filtered)
- mrfakename/Pure-Dove-ShareGPT: Processed 3707, Removed 150
- mrfakename/Capybara-ShareGPT: Processed 13412, Removed 2594
- jondurbin/airoboros-3.2: Processed 54517, Removed 4192
- PJMixers/grimulkan_theory-of-mind-ShareGPT: Processed 533, Removed 6
- grimulkan/PIPPA-augmented-dedup: Processed 869, Removed 46
- grimulkan/LimaRP-augmented: Processed 790, Removed 14
- PJMixers/grimulkan_physical-reasoning-ShareGPT: Processed 895, Removed 4
- MinervaAI/Aesir-Preview: Processed 994, Removed 6
- Doctor-Shotgun/no-robots-sharegpt: Processed 9911, Removed 89
Deduplication Stats:
Starting row count: 85628, Final row count: 81960, Rows removed: 3668