How to use Bunemon/sft_dpo_smallsharp_base with PEFT:
Task type is invalid.
The community tab is the place to discuss and collaborate with the HF community!