| | --- |
| | base_model: mistralai/Mistral-Nemo-Base-2407 |
| | license: apache-2.0 |
| | datasets: |
| | - BeaverAI/Nemo-Inst-Tune-ds |
| | language: |
| | - en |
| | library_name: transformers |
| | --- |
| | # Dory 12b (v2) |
| | (redone) redone instruct finetune of mistral nemo 12b's base. *not* (E)RP-focused, leave that to drummer. |
| |
|
| |  |
| |
|
| | thanks to twisted again for the compute :3 |
| |
|
| | ## Prompting |
| | alpaca-like: |
| | ``` |
| | ### System: |
| | [Optional system prompt] |
| | |
| | ### Instruction: |
| | [Query] |
| | |
| | ### Response: |
| | [Response]</s> |
| | |
| | ### Instruction: |
| | [...] |
| | ``` |
| |
|
| | ## Training details |
| | Rank 64 QDoRA, trained on the following data mix: |
| | - All of [kalomaze/Opus_Instruct_3k](https://huggingface.co/datasets/kalomaze/Opus_Instruct_3k) |
| | - All conversations with a reward model rating above 5 in [Magpie-Align/Magpie-Gemma2-Pro-Preview-Filtered](https://huggingface.co/datasets/Magpie-Align/Magpie-Gemma2-Pro-Preview-Filtered) |
| | - 50k of [Gryphe/Sonnet3.5-SlimOrcaDedupCleaned](https://huggingface.co/datasets/Gryphe/Sonnet3.5-SlimOrcaDedupCleaned) |
| | - All stories above 4.7 rating and published before 2020 in [Fizzarolli/FallingThroughTheSkies-592k-Filtered-Filtered](https://huggingface.co/datasets/Fizzarolli/FallingThroughTheSkies-592k-Filtered-Filtered) |
