Comparing alignment methods (DPO/SimPO/IPO/GRPO/CAI) on a sycophantic Qwen3-8B model organism. Surface vs deep removal.
Narasimha Karthik Jwalapuram
JNK789
·
AI & ML interests
Deep Learning, Computer vision and NLP
Organizations
None yet
models 20
JNK789/sycophancy-recovery-qwen3-8b-cai-dpo-adapter
Updated
JNK789/sycophancy-recovery-qwen3-8b-cai-dpo
8B • Updated • 2
JNK789/sycophancy-recovery-qwen3-8b-cai-sl-adapter
Updated
JNK789/sycophancy-recovery-qwen3-8b-cai-sl
8B • Updated • 3
JNK789/sycophancy-recovery-qwen3-8b-sft-adapter
Updated
JNK789/sycophancy-recovery-qwen3-8b-sft
8B • Updated • 3
JNK789/sycophancy-recovery-rm-adapter
Updated
JNK789/sycophancy-recovery-rm
8B • Updated • 7
JNK789/sycophancy-recovery-qwen3-8b-grpo-v4-binary-adapter
Updated
JNK789/sycophancy-recovery-qwen3-8b-grpo-v4-binary
8B • Updated • 2