geyuxu commited on
Commit
d12fb7a
·
verified ·
1 Parent(s): 1dcde53

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
4
+ tags: [dpo, lora, self-training, label-quality]
5
+ ---
6
+ # Self-Training Loop — Phase 2 A'' three-arm ablation adapters
7
+
8
+ Six LoRA adapters (Qwen2.5-1.5B-Instruct, r16, lr 1e-5, beta 0.1, 2 epochs, seeds 22/23):
9
+
10
+ - `D_full_emf1_seed{22,23}` — 10,000 preference pairs, original EM/F1 directions
11
+ - `D_full_corrected_seed{22,23}` — same 10,000 pairs with 375 judge-verified hurts-direction flips
12
+ - `D_verified_seed{22,23}` — 3,185 semantically verified pairs (hybrid accept pool)
13
+
14
+ Companion dataset repo: `self-training-loop-phase2-arms` (training arms, eval chain,
15
+ human adjudication records). Key result: direction repair at 3.75% flip rate produces
16
+ no detectable behavioral difference (two seeds, reference-based and blind pairwise
17
+ LLM-judge evaluation) — see the thesis repo Phase 2 execution status doc §15.22.