File size: 558 Bytes
f79b6e1 95956c7 ba0f54d f79b6e1 95956c7 ba0f54d |
1 2 3 4 5 6 7 8 9 10 |
---
base_model: []
tags:
- mergekit
- merge
license: cc-by-nc-2.0
---
# This is an experimental model that I made by merging two Llama2 70b models and gluing them together with the mergekit of llama70b. The mergekit is a tool that lets me mix and match different models into one big model, keeping all the smarts and skills of the original models. The llama70b is a huge language model that can make words for all kinds of things and ways, based on the GPT-4 thingy.
The merged model has 54 billion thingamajigs and was made trained on 640GB of vram cluster |