jondurbin/gutenberg-dpo-v0.1
Viewer • Updated • 918 • 1.27k • 164
Shout-out to @huihui-ai for the abliterated model!
huihui-ai/Qwen2.5-VL-3B-Instruct-abliterated finetuned on:
QLoRA ORPO tuned with 2x 3090s for 2 epochs.
Base model
Qwen/Qwen2.5-VL-3B-Instruct