metadata
base_model:
- Delta-Vector/Rei-V3-KTO-12B
- Retreatcost/Chrysologus-12B
- Vortex5/Harmony-Bird-12B
- Vortex5/Red-Synthesis-12B
- Vortex5/Lunar-Nexus-12B
- Vortex5/Scarlet-Eclipse-12B
library_name: transformers
tags:
- mergekit
- merge
- roleplay
NoctyxCosma-12B
Overview
NoctyxCosma-12B was created by merging Harmony-Bird-12B, Chrysologus-12B, Rei-V3-KTO-12B, Scarlet-Eclipse-12B, Lunar-Nexus-12B, and Red-Synthesis-12B using a custom merge method.
Show merge configuration
models:
- model: Vortex5/Harmony-Bird-12B
- model: Retreatcost/Chrysologus-12B
- model: Delta-Vector/Rei-V3-KTO-12B
- model: Vortex5/Scarlet-Eclipse-12B
- model: Vortex5/Lunar-Nexus-12B
- model: Vortex5/Red-Synthesis-12B
merge_method: smi_oni
parameters:
k_core: 2
strength_core: 1.0
consensus_core: 0.48
drop_cos: 0.10
drop_min: 3
strength_nov: 0.45
novelty_budget: 0.22
consensus_nov: 0.32
conflict_bonus: 0.18
dtype: bfloat16
tokenizer:
source: Vortex5/Red-Synthesis-12B
Intended Use
Creative Writing
Storytelling
Roleplay