base_model:
- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
- unsloth/Llama-3.3-70B-Instruct
- TheDrummer/Anubis-70B-v1
- Sao10K/70B-L3.3-Cirrus-x1
library_name: transformers
tags:
- mergekit
- merge
L3.3-Faust-70B-exp.001
This is a merge of pre-trained language models created using mergekit.
In case it wasn't obvious, I'm still experimenting. Hopefully the next few ones in this Faust series have actual reasoning in this section for how and why I did things, but for now it's just a silly merge by a noob.
I don't know what I'm doing yet - still reading and picking up on a lot of things, so I thought I'd give runpod and mergekit a quick shot.
Found some good and bad during testing. Will need to work on that first before continuing to merge. It was fun to learn how to merge and host this, however.
Merge Details
Merge Method
This model was merged using the Model Stock merge method using unsloth/Llama-3.3-70B-Instruct as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
base_model: unsloth/Llama-3.3-70B-Instruct
merge_method: model_stock
dtype: bfloat16
models:
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
- model: Sao10K/70B-L3.3-Cirrus-x1
- model: TheDrummer/Anubis-70B-v1