File size: 774 Bytes
ca880bd 3652cd0 ca880bd 3652cd0 2ca7ed1 41b4e78 8cf851e 2b2e4dc ca880bd 3652cd0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | ---
base_model:
- mistralai/Mistral-Small-3.2-24B-Instruct-2506
datasets:
- ConicCat/AntiRep
---
**Mistral-Small-3.2-AntiRep-24B:**
- Exactly what it says on the tin, Orpo'd Mistral Small 3.2 to remove repetition.
- Trained to reduce infinite repetition, repetition of structure and sentences in multi turn conversation, and repetition within responses.
- Got really annoyed with all of my Mistral Small test models having repetition issues, so I decided to whip this up.
- Produced by doing orpo with Qwen 3 8B at 0 temp + .7 rep pen (<1 increases repetition) as rejected vs V3 03/24 as chosen.
- The [LoRA](https://huggingface.co/ConicCat/Mistral-Small-3.2-AntiRep-24B-LoRA) is also available too, if you want to use it to reduce repetition on other MS3.2 tunes.
Enjoy! |