| base_model: Qwen/Qwen3-4B-Instruct-2507 | |
| library_name: peft | |
| tags: | |
| - lora | |
| - meta-learning | |
| - arc-agi | |
| - test-time-training | |
| # meta_ttt_arc_v1 — second-order MAML LoRA on ARC-AGI | |
| LoRA adapter for `Qwen/Qwen3-4B-Instruct-2507` trained via second-order | |
| inner-checkpoint MAML on the ARC-AGI ICL-QA task. Best checkpoint by | |
| training-time val/post/f1. | |
| ## Experiment | |
| - name: `arc_so_iclqa_v2_r32_K6_long_0606c` | |
| - meta step: 900 | |
| - val/post/f1 (train-time monitoring): 0.2631578947368421 | |
| - LoRA rank: 32, alpha: 64, target_modules: all-linear | |
| - Inner: K=6 Adam steps, ilr=2e-4, kl_lambda=0.1 | |
| - Outer: 1500 meta steps, cosine 1e-4, warmup 50, bs=64 outer-QAs | |
| - Trained on `HerrHruby/arc_agi_mini_docs` (v2 mini-docs) | |
| ## Test-time use | |
| The intended use is meta-test-time training: load the adapter, run a few | |
| Adam steps on the task's `inner_docs` for the test example, then generate | |
| the outer answer. See the codebase for `inner_loop_batched_adam_seqgrad_nograph`. | |
| ## License | |
| Apache-2.0 (inherits from base model). | |