| --- |
| language: |
| - en |
| - fr |
| base_model: |
| - mistralai/Mistral-Small-24B-Base-2501 |
| tags: |
| - roleplay |
| - deepseek |
| - rp |
| - r1 |
| - mistral |
| - distill |
| --- |
| # MistralThinker Model Card |
|
|
| Please, read this: https://huggingface.co/Undi95/MistralThinker-v1.1/discussions/1 \ |
| Prefill required for the Assistant: `<think>\n` |
|
|
| ## Model Description |
|
|
| **Model Name:** MistralThinker\ |
| **Version:** 1.1\ |
| **Prompt Format:** Mistral-V7 |
|
|
| ``` |
| [SYSTEM_PROMPT]{system prompt}[/SYSTEM_PROMPT][INST]{user message}[/INST]{assistant response}</s> |
| ``` |
|
|
| This model is a specialized variant of **Mistral-Small-24B-Base-2501**, adapted using a **DeepSeek R1** distillation process. It is **primarily designed for roleplay (RP) and storywriting** applications, focusing on character interactions, narrative generation, and creative storytelling. Approximately **40% of the training dataset** consists of roleplay/storywriting/character card data, ensuring rich and contextually immersive outputs in these domains. |
|
|
| ## Model Sources |
|
|
| - **Base Model:** [Mistral-Small-24B-Base-2501](https://huggingface.co/mistralai/Mistral-Small-24B-Base-2501) |
| - **Fine-Tuning Approach:** DeepSeek R1 process (focused on RP) |
| - **Dataset Size:** The dataset used in training **doubled** since the last version, adding more neutral logs, training the Base model to stick more on my new format. |
|
|
| ## Intended Use |
|
|
| - **Primary Use Cases:** |
| - **Roleplay (RP):** Engaging with users in fictional or scenario-based interactions. |
| - **Storywriting:** Generating narratives, character dialogues, and creative texts. |
| - **Character Lore Generation:** Serving as a resource to craft or expand on character backstories and interactions. |
|
|
| - **How To Use:** |
| 1. **User-First Message:** The first message in any interaction should come from the user, ensuring the model responds in a narrative or roleplay context guided by user input. |
| 2. **Contextual Information:** User or assistant details can be placed either in the system prompt or the user's first message. A system prompt is **not mandatory**, but any contextual instructions or role descriptions can help set the stage. |
| 3. **DeepSeek-Style Interaction:** The model can also be used purely as a **DeepSeek distill** without additional system prompts, providing flexible usage for direct storytelling or roleplay scenarios. The model still can be biased toward Roleplay data, and it is expected. |
|
|
| ## Training Data |
|
|
| - **DeepSeek R1 Thinking Process:** The model inherits a refined chain-of-thought (thinking process) from DeepSeek R1, which places heavy emphasis on **roleplay** and narrative coherence. |
| - **Dataset Composition:** |
| - 40%: RP/Storywriting/Character Cards |
| - 60%: Various curated data for broad language, math, logical, space... understanding |
| - **Data Scaling:** The dataset size was **doubled** compared to previous iterations, which enhances the model’s creative and contextual capabilities. |
|
|
| ## Model Performance |
|
|
| - **Strengths:** |
| - **Storytelling & Roleplay:** Rich in creative generation, character portrayal, and scenario building. |
| - **Dialogue & Interaction:** Capable of sustaining engaging and context-driven dialogues. |
| - **Adaptability:** Can be used with or without a system prompt to match a range of user preferences. |
|
|
| - **Limitations & Bias:** |
| - **Hallucination:** It can generate fictitious information in the thinking process, but still end up with a succesfull reply. |
| - **Thinking can be dismissed:** Being a distillation of DeepSeek R1 is essence, this model, even trained on Base, could forget to add `<think>\n` in some scenario. |
|
|
| ## Ethical Considerations |
|
|
| - Yes |
|
|
| ## Usage Recommendations |
|
|
| 1. **System Prompt (Optional):** |
| You may provide a high-level system prompt detailing the scenario or the desired style of roleplay and storywriting. |
| _Example: "You are a friendly fantasy innkeeper who greets travelers from distant lands."_ |
|
|
| 2. **User’s First Message:** |
| - Must clearly state or imply the scenario or context if no system prompt is provided. |
| _Example: "Hello, I’m a wandering knight seeking shelter. Could you share a story about local legends?"_ |
|
|
| 3. **Roleplay & Storywriting Focus:** |
| - Encourage the model to develop characters, backstories, and immersive dialogues. |
| - For more direct, unfiltered or freeform creativity, skip the system prompt. |
| - If you still want to have some "logs" from previous message before starting a conversation, put them in the first user message, or in the system prompt. |
| - You can put exemple message of the character you RP with in the system prompt, too. |
|
|
|  |
|  |
