---
base_model: []
library_name: transformers
tags:
- mergekit
- merge

---
# prototype-0.2--lazy-unpickle

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using /workspace/cache/models--huihui-ai--Llama-3.3-70B-Instruct-abliterated/snapshots/fa13334669544bab573e0e5313cad629a9c02e2c as a base.

### Models Merged

The following models were included in the merge:
* /workspace/cache/models--allenai--Llama-3.1-Tulu-3-70B/snapshots/cfc1d855e534a0b9b82a9cea6bf9e8dda30b10d7
* /workspace/cache/models--mlabonne--Hermes-3-Llama-3.1-70B-lorablated/snapshots/4295cb5975cacb8ddf4595557c931b6430cf8d6d
* /workspace/cache/models--ReadyArt--Forgotten-Safeword-70B-v5.0/snapshots/ac2650005a6fdef7f4cd62590dcb665155349a5b

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: /workspace/cache/models--mlabonne--Hermes-3-Llama-3.1-70B-lorablated/snapshots/4295cb5975cacb8ddf4595557c931b6430cf8d6d
  - model: /workspace/cache/models--allenai--Llama-3.1-Tulu-3-70B/snapshots/cfc1d855e534a0b9b82a9cea6bf9e8dda30b10d7
  - model: /workspace/cache/models--ReadyArt--Forgotten-Safeword-70B-v5.0/snapshots/ac2650005a6fdef7f4cd62590dcb665155349a5b
  - model: /workspace/cache/models--huihui-ai--Llama-3.3-70B-Instruct-abliterated/snapshots/fa13334669544bab573e0e5313cad629a9c02e2c
base_model: /workspace/cache/models--huihui-ai--Llama-3.3-70B-Instruct-abliterated/snapshots/fa13334669544bab573e0e5313cad629a9c02e2c
merge_method: model_stock
tokenizer:
  source: union
int8_mask: true
dtype: float32
out_dtype: bfloat16
```