|
|
--- |
|
|
base_model: |
|
|
- Vortex5/MS3.2-24B-Fiery-Lynx |
|
|
- ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0 |
|
|
- Vortex5/MS3.2-24B-Chaos-Skies |
|
|
library_name: transformers |
|
|
tags: |
|
|
- mergekit |
|
|
- merge |
|
|
- roleplay |
|
|
--- |
|
|
 |
|
|
|
|
|
# 🔥 **MS3.2-24B-Solar-Skies** |
|
|
|
|
|
> Bright minds under boundless skies — where every conversation becomes a sunrise of imagination |
|
|
|
|
|
|
|
|
## 🧬 Overview |
|
|
|
|
|
**MS3.2-24B-Solar-Skies** merge of pre-trained language models created using [MergeKit](https://github.com/arcee-ai/mergekit). |
|
|
It draws upon the **intellectual density** of *The Omega Directive*, the **expressive prose** of *Fiery Lynx*, and the **measured balance** of *Chaos Skies*. |
|
|
|
|
|
--- |
|
|
|
|
|
## ⚙️ **Merge Method — [Multi-SLERP](https://goddard.blog/posts/multislerp-wow-what-a-cool-idea)** |
|
|
|
|
|
🧩 **Models:** |
|
|
- 🧠 [ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0](https://huggingface.co/ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0) |
|
|
- 🔥 [Vortex5/MS3.2-24B-Fiery-Lynx](https://huggingface.co/Vortex5/MS3.2-24B-Fiery-Lynx) |
|
|
- 🌌 [Vortex5/MS3.2-24B-Chaos-Skies](https://huggingface.co/Vortex5/MS3.2-24B-Chaos-Skies) |
|
|
|
|
|
<details> |
|
|
<summary><b>Configuration</b></summary> |
|
|
|
|
|
```yaml |
|
|
models: |
|
|
- model: ReadyArt/MS3.2-The-Omega-Directive-24B-Unslop-v2.0 |
|
|
parameters: |
|
|
weight: |
|
|
- filter: self_attn |
|
|
value: [0.20, 0.35, 0.55, 0.75, 1.00, 0.95, 0.80, 0.50] |
|
|
- filter: norm |
|
|
value: 0.45 |
|
|
- value: 0.33 |
|
|
- model: Vortex5/MS3.2-24B-Fiery-Lynx |
|
|
parameters: |
|
|
weight: |
|
|
- filter: lm_head |
|
|
value: 0.34 |
|
|
- filter: mlp |
|
|
value: [0.20, 0.30, 0.45, 0.60, 0.65, 0.60, 0.45, 0.30] |
|
|
- value: 0.25 |
|
|
- model: Vortex5/MS3.2-24B-Chaos-Skies |
|
|
parameters: |
|
|
weight: |
|
|
- filter: self_attn |
|
|
value: [0.25, 0.35, 0.45, 0.55, 0.60, 0.65, 0.65, 0.60] |
|
|
- filter: mlp |
|
|
value: 0.2 |
|
|
- value: 0.33 |
|
|
merge_method: multislerp |
|
|
dtype: bfloat16 |
|
|
parameters: |
|
|
normalize: true |
|
|
tokenizer: |
|
|
source: Vortex5/MS3.2-24B-Chaos-Skies |
|
|
``` |
|
|
</details> |
|
|
|
|
|
## 🎭 Intended Use |
|
|
| Category | Description | |
|
|
|-----------|--------------| |
|
|
| 🧘 **Reflective Dialogue** | Ideal for introspective or philosophical discussions, exploring abstract and emotional topics. | |
|
|
| 🖋️ **Creative Writing** | Excels at expressive prose, narrative storytelling, and immersive worldbuilding. | |
|
|
| 🧠 **Analytical Reasoning** | Balances logic and creativity for insightful, stylistically nuanced explanations. | |
|
|
| 💞 **Character Roleplay** | Adapts fluidly to emotional, character-driven interactions and narrative depth. | |
|
|
|
|
|
--- |
|
|
|
|
|
# 🌒 Acknowledgements |
|
|
|
|
|
- ⚙️ mradermacher — static / imatrix quantization |
|
|
|
|
|
- 🜛 DeathGodlike — EXL3 quants |
|
|
|
|
|
- 💫 All original model authors and contributors whose work formed the foundation for this merge. |
