KTO-V5 / README.md
Delta-Vector's picture
Upload folder using huggingface_hub
7102fae verified
---
base_model:
- kalomaze/nemo-subseq-perseq-e1.5
library_name: transformers
tags:
- mergekit
- merge
---
# v5
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the Passthrough merge method using [kalomaze/nemo-subseq-perseq-e1.5](https://huggingface.co/kalomaze/nemo-subseq-perseq-e1.5) + /alloc/Mango/axolotl/0.0001_5e-6_ademamix_0.01-WD-New-Data-v5/checkpoint-1354 as a base.
### Models Merged
The following models were included in the merge:
### Configuration
The following YAML configuration was used to produce this model:
```yaml
base_model: kalomaze/nemo-subseq-perseq-e1.5+/alloc/Mango/axolotl/0.0001_5e-6_ademamix_0.01-WD-New-Data-v5/checkpoint-1354
dtype: bfloat16
merge_method: passthrough
models:
- model: kalomaze/nemo-subseq-perseq-e1.5+/alloc/Mango/axolotl/0.0001_5e-6_ademamix_0.01-WD-New-Data-v5/checkpoint-1354
```