Model Stock: All we need is just a few fine-tuned models
Paper
•
2403.19522
•
Published
•
13
base10
Merge of Tess 3 105b, EVA Unit 105b, and Hydroblated 105b, with Anubis 105b as the base.
Merge Details
Merge Method
This model was merged using the Model Stock merge method using /workspace/cache/models--TheDrummer--Anubis-Pro-105B-v1/snapshots/2bbf619c35ffcb8ae3fe7f7b5a62948aab0f3022 as a base.
Models Merged
The following models were included in the merge:
- /workspace/cache/models--bruhzair--ignore-merge-17/snapshots/bd0af76a6bc4d9ae4bab5fa6b50e6545e6f3fd4f
- /workspace/cache/models--bruhzair--ignore-merge-6/snapshots/87658005d40b593ba3e87e92e5fb3f28321266a1
- /workspace/cache/models--bruhzair--ignore-merge-3/snapshots/6255d5dbe071987b8ff4567ea91f08d6499fdeff
Configuration
The following YAML configuration was used to produce this model:
base_model: /workspace/cache/models--TheDrummer--Anubis-Pro-105B-v1/snapshots/2bbf619c35ffcb8ae3fe7f7b5a62948aab0f3022
merge_method: model_stock
modules:
default:
slices:
- sources:
- layer_range: [0, 120]
model: /workspace/cache/models--bruhzair--ignore-merge-3/snapshots/6255d5dbe071987b8ff4567ea91f08d6499fdeff
- layer_range: [0, 120]
model: /workspace/cache/models--bruhzair--ignore-merge-6/snapshots/87658005d40b593ba3e87e92e5fb3f28321266a1
- layer_range: [0, 120]
model: /workspace/cache/models--bruhzair--ignore-merge-17/snapshots/bd0af76a6bc4d9ae4bab5fa6b50e6545e6f3fd4f
- layer_range: [0, 120]
model: /workspace/cache/models--TheDrummer--Anubis-Pro-105B-v1/snapshots/2bbf619c35ffcb8ae3fe7f7b5a62948aab0f3022
- Downloads last month
- -