Instructions to use cd1313/qwen3-wrong-dpo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use cd1313/qwen3-wrong-dpo with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/qwen3-1.7b-unsloth-bnb-4bit") model = PeftModel.from_pretrained(base_model, "cd1313/qwen3-wrong-dpo") - Notebooks
- Google Colab
- Kaggle
File size: 133 Bytes
8f10575 | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:476870a1f2fb6f6a2759a6ede2383bf9d5d738f17844563b65c91965b722ae09
size 11422924
|