README.md

---
base_model:
- ServiceNow-AI/Apriel-Nemotron-15b-Thinker
datasets:
- Undi95/R1-RP-ShareGPT3
- PJMixers-Dev/Gryphe-Aesir-RPG-Charcards-Opus-Mixed-split-v3-0324
---

### Apriel R1P V.2

Day 2 RP finetune of Apriel 15B, with several iterative improvements from the first version. In particular, coherence at good temperatures (~.7) should be much higher.

I also fully converted the model to use the Phi 3 format; this comes at the slight tradeoff of the `<|end|>` tag not always tokenizing exactly the same way in a few niche scenarios.

Further attempts were made to fix formatting issues with asterisks on the base model.

NOTE: THIS IS THE THINKING VERSION

Upon further testing, I discovered that while merging back onto the instruct improved thinking mode, this came at the cost of degraded non-thinking outputs.

Use the [non-thinking version](https://huggingface.co/ConicCat/Apriel-R1PV.2-NoThink) instead if you want a standard model.

## Thinking Mode

- To enable thinking place `/think` in the system prompt and prefill `<|think|>\n` for thinking mode.

- Phi esque thinking tags, `<|think|>` and `<|/think|>` have been added to the model.

- Remember to reconfigure Sillytavern to parse the new think tags.

## Settings

The chat template has been converted to a Phi 3 template as the model seemed to respond best to this format.

This model does prefer having character cards placed in user messages, not the system prompt.

## Special Thanks:

Undi95 for portions of their dataset and inspiration.

PJMixers-Dev for their dataset curation and creation efforts.