---
base_model: []
library_name: transformers
tags:
- mergekit
- merge

---
# Narratrix

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method.

### Models Merged

The following models were included in the merge:
* gghfez/Writer-Large-2411-v2.1
* NeverSleep/Lumimaid-v0.2-123B
* mistralai/Mistral-Large-Instruct-2411
* nbeerbower/Gigaberg-Mistral-Large-123B
* TheDrummer/Behemoth-123B-v2.2
* migtissera/Tess-3-Mistral-Large-2-123B
* anthracite-org/magnum-v4-123b

### Configuration

The following YAML configuration was used to produce this model:

```yaml
merge_method: linear
models:
    - model: mistralai/Mistral-Large-Instruct-2411
      parameters:
        weight: 0.13
    - model: nbeerbower/Gigaberg-Mistral-Large-123B
      parameters:
        weight: 0.145
    - model: migtissera/Tess-3-Mistral-Large-2-123B
      parameters:
        weight: 0.145
    - model: anthracite-org/magnum-v4-123b
      parameters:
        weight: 0.145
    - model: NeverSleep/Lumimaid-v0.2-123B
      parameters:
        weight: 0.145
    - model: TheDrummer/Behemoth-123B-v2.2
      parameters:
        weight: 0.145
    - model: gghfez/Writer-Large-2411-v2.1
      parameters:
        weight: 0.145
dtype: bfloat16

```