--- base_model: - ServiceNow-AI/Apriel-Nemotron-15b-Thinker datasets: - Undi95/R1-RP-ShareGPT3 - PJMixers-Dev/Gryphe-Aesir-RPG-Charcards-Opus-Mixed-split-v3-0324 --- ### Apriel R1P V.2 Day 2 RP finetune of Apriel 15B, with several iterative improvements from the first version. In particular, coherence at good temperatures (~.7) should be much higher. I also fully converted the model to use the Phi 3 format; this comes at the slight tradeoff of the `<|end|>` tag not always tokenizing exactly the same way in a few niche scenarios. Further attempts were made to fix formatting issues with asterisks on the base model. NOTE: THIS IS THE THINKING VERSION Upon further testing, I discovered that while merging back onto the instruct improved thinking mode, this came at the cost of degraded non-thinking outputs. Use the [non-thinking version](https://huggingface.co/ConicCat/Apriel-R1PV.2-NoThink) instead if you want a standard model. ## Thinking Mode - To enable thinking place `/think` in the system prompt and prefill `<|think|>\n` for thinking mode. - Phi esque thinking tags, `<|think|>` and `<|/think|>` have been added to the model. - Remember to reconfigure Sillytavern to parse the new think tags. ## Settings The chat template has been converted to a Phi 3 template as the model seemed to respond best to this format. This model does prefer having character cards placed in user messages, not the system prompt. ## Special Thanks: Undi95 for portions of their dataset and inspiration. PJMixers-Dev for their dataset curation and creation efforts.