File size: 3,644 Bytes
9e64215 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa 9e64215 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa f7d79f6 fcd65aa 9e64215 fcd65aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 |
---
base_model:
- Vortex5/LunaMaid-12B
- Vortex5/Vermilion-Sage-12B
- inflatebot/MN-12B-Mag-Mell-R1
- Vortex5/Dark-Quill-12B
library_name: transformers
tags:
- mergekit
- merge
- roleplay
---
# 🌌 **Abyssal-Seraph-12B**
> *Where the light of the divine meets the poetry of the abyss.*
---
## 🜂 Overview
**Abyssal-Seraph-12B** is a **multi-stage creative merge** designed for expressive storytelling, emotional depth, and lyrical dialogue.
It was crafted through a layered fusion using [MergeKit](https://github.com/arcee-ai/mergekit):
1. 🌙 **LunaMaid × Vermilion-Sage** — merged via **NearSwap** (`t=0.0008`) to unify LunaMaid’s balanced composure with Vermilion-Sage’s radiant prose.
2. 🕯️ **Dark-Quill × Mag-Mell-R1** — merged via **NearSwap** (`t=0.0008`) to draw forth mysticism, poetic darkness, and a sense of dreamlike gravity.
3. ✨ Both intermediate results combined with the **Karcher Mean** — a geometric blend ensuring harmony between light and shadow.
---
## 🩶 Model Essence
| Trait | Description |
|:--|:--|
| 🧠 **Core Nature** | Philosophical, poetic, emotionally resonant |
| 💬 **Style** | Fluid prose, vivid imagery, articulate reflection |
| 💫 **Tone** | Dreamlike, balanced between divine warmth and abyssal calm |
| 🎭 **Best For** | Roleplay, character dialogue, introspection, lore writing, creative prose |
---
🧬 Merge Overview
Abyssal-Seraph-12B was created through a multi-stage, precision merge designed to blend expressive prose with poetic balance while maintaining model stability.
### 🌙 **Stage 1**
**✨ Method:** NearSwap (`t = 0.0008`)
**🩵 Base:** [Vortex5/LunaMaid-12B](https://huggingface.co/Vortex5/LunaMaid-12B)
**💮 Secondary:** [Vortex5/Vermilion-Sage-12B](https://huggingface.co/Vortex5/Vermilion-Sage-12B)
<details>
<summary><b>Stage 1 Configuration</b></summary>
```yaml
name: First
models:
- model: Vortex5/Vermilion-Sage-12B
merge_method: nearswap
base_model: Vortex5/LunaMaid-12B
parameters:
t: 0.0008
dtype: bfloat16
tokenizer:
source: Vortex5/LunaMaid-12B
```
</details>
### 🩶 **Stage 2**
⚙️ Method: NearSwap (t = 0.0008)
🖤 Base: Vortex5/Dark-Quill-12B
💫 Secondary: inflatebot/MN-12B-Mag-Mell-R1
<details>
<summary><b>Stage 2 Configuration</b></summary>
```yaml
name: Second
models:
- model: inflatebot/MN-12B-Mag-Mell-R1
merge_method: nearswap
base_model: Vortex5/Dark-Quill-12B
parameters:
t: 0.0008
dtype: bfloat16`
```
</details>
### 🌌 Stage 3 — **Final Merge**
⚖️ Method: Karcher Mean (tol = 1e-9, max_iter = 20000)
🜂 Inputs: First + Second
💎 Purpose:
To geometrically fuse both for coherence.
<details>
<summary><b>Final Merge Configuration</b></summary>
```yaml
models:
- model: First
- model: Second
merge_method: karcher
dtype: bfloat16
parameters:
tol: 1e-9
max_iter: 20000
tokenizer:
source: First
```
</details>
## 🌑🜂 **Acknowledgements** 🜂🌑
- ⚙️ **mradermacher** — for *static* and *imatrix quantization*
- 🜛 **DeathGodlike** — for *EXL3 quants*
- 🩶 **All original model authors and contributors** whose work made this model possible.
---
**Models merged in this creation:**
- [Vortex5/LunaMaid-12B](https://huggingface.co/Vortex5/LunaMaid-12B)
- [Vortex5/Vermilion-Sage-12B](https://huggingface.co/Vortex5/Vermilion-Sage-12B)
- [Vortex5/Dark-Quill-12B](https://huggingface.co/Vortex5/Dark-Quill-12B)
- [inflatebot/MN-12B-Mag-Mell-R1](https://huggingface.co/inflatebot/MN-12B-Mag-Mell-R1) |