HOS-1 / README.md
Timelyyyy's picture
Update README.md
ee747ea verified
|
Raw History Blame Contribute Delete
1.16 kB
---
license: gemma
language:
- en
base_model:
- google/gemma-2-2b
- ArliAI/Gemma-2-2B-ArliAI-RPMax-v1.1
tags:
- 2b
- Text-Generation
- merge
- qlora
- conversational
---
<h1>This is a joke model trained on actual messages. It sometimes spits tenor links but try to ignore that</h1>
<p style="color:red;">QLoRa applied on ArliAI/Gemma-2-2B-ArliAI-RPMax-v1.1<p>
<p>Basically i was bored out of my mind and decided to make a QLoRa, which you now see as this merged model. It can still answer basic questions but doesn't have any kind of reasoning capability and doesn't seem to write code.</p>
<p>I wanted 1 epoch initially, but 103 steps was enough. Might finish it later but idk we'll see.</p>
<p>The recomended penalties are the same as gemma, use rep pen 1.1-1.3 maybe and like 0.3-0.8 temperature depending on how lost it is. Lower Top K is better, like 40. </p>
<p style="color: pink; font-size:1em;"> This model WILL be saying some wild stuff and i do not carry the responisbility for the answers it gives. Personal use only. </p>
<img src="https://file.garden/aSVi7A-81Gu_AES6/Screenshot%202026-10-31%20110647.png" alt="settings" width="20%" height="20%">