QuantFactory/MN-12b-Sunrose-GGUF
This is quantized version of Fizzarolli/MN-12b-Sunrose created using llama.cpp
Original Model Card
output
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the passthrough merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Fizzarolli/MN-12b-Rosier-v1+Fizzarolli/nemo-sunfall-v0.6.1-adapter-on-base
merge_method: passthrough
- Downloads last month
- 9
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support