Add README
Browse files
README.md
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# 0.6_4b_mean_causal_embed
|
| 2 |
+
|
| 3 |
+
Embed model: `Qwen/Qwen3-Embedding-0.6B`
|
| 4 |
+
LLM model: `Qwen/Qwen3-4B-Instruct-2507`
|
| 5 |
+
|
| 6 |
+
## Checkpoints
|
| 7 |
+
|
| 8 |
+
**Stage 0** (2 checkpoints): stage0_final, stage0_step_5000
|
| 9 |
+
**Stage 1** (2 checkpoints): stage1_final, stage1_step_10000
|
| 10 |
+
**Stage 2** (4 checkpoints): stage2_final, stage2_step_10000, stage2_step_20000, stage2_step_24000
|
| 11 |
+
**Stage 3** (1 checkpoints): stage3_step_809
|