Model Information

Sol-Reaver-15B-Instruct

15B parameters Creative / Fresh Prose Co-writing/Roleplay/Adventure Generalist

Quantized Versions

Available Downloads

GGUF FormatFor use with LLama.cpp & Forks(Coming Soon!)
EXL2 FormatFor use with TabbyAPI (Coming Soon!)

Prompting

Model has been tuned with the ChatML formatting. A typical input would look like this:

<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant

System Prompting

I would highly recommend using either Euryale's system prompt or the EVA system prompt with the model.

See Axolotl Config


              https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-7d4ecudg/v0/files/axolotl_config_avyx566_.yml

Training

The training was done for 1 epoch using 8 x H200s GPUs graciously provided by Kalomaze for the fine-tuning of the model.

Credits

Thank you to Lucy Knada, Ateron, Alicat, Intervitens, Cgato, Kubernetes Bad and the rest of Anthracite.

NewEden-Forge
/

readme-testing

François-PE-Huali 12B