|
|
--- |
|
|
license: cc-by-nc-4.0 |
|
|
language: |
|
|
- en |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
<p align="center"><font size="7"> What an oddly stubborn model.</font></p> |
|
|
<p align="center"><font size="5"> <b>4-bit Examples with Alpaca</b></font></p> |
|
|
<p align="center"><img src="https://iili.io/JIKcfdG.png"/> |
|
|
<p align="center"><font size="5"><b><a href="https://iili.io/JIKcq7f.png">!!NSFW!! - Erotica Writing Example - !!NSFW!!</font></a></b></p> |
|
|
<p align="center"><font size="4"><i>While I like this NSFW output, I had to change my standard test prompt nearly a dozen times to get it to produce anything smut-like.</i></p> |
|
|
<p align="center"><font size="4"><i>There were zero refusals, just sappy Young Adult romance nonsense.</i></p> |
|
|
|
|
|
### Recipe |
|
|
merge_method: dare_ties |
|
|
|
|
|
- base_model: athirdpath/BigMistral-11b |
|
|
|
|
|
- model: athirdpath/DoublePivot-11b |
|
|
|
|
|
weight: [0.20, 0.34, 0.42, 0.53, 0.60] / density: 0.45 |
|
|
|
|
|
- model: athirdpath/DoubleMaid-11b |
|
|
|
|
|
weight: [0.65, 0.51, 0.43, 0.32, 0.25] / density: [0.60, 0.54, 0.50, 0.48, 0.40] |
|
|
|
|
|
- model: athirdpath/BigMistral-11b-GLUED |
|
|
|
|
|
weight: 0.15 / density: 0.40 |
|
|
|
|
|
int8_mask: true |
|
|
|
|
|
dtype: bfloat16 |
