File size: 899 Bytes
26460cb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 | ---
license: mit
tags: [code, lora, hypernetwork, peft, recurrent]
---
# Code2LoRA-GRU — streaming hypernetwork
Final checkpoint of the **streaming Code2LoRA-GRU** used in the paper. A
1-layer GRU rolls the recurrence over per-commit diff embeddings and emits
a rank-16 LoRA adapter for `Qwen/Qwen2.5-Coder-1.5B` at *O(1)* per commit.
## Files
| File | Description |
|---|---|
| `code2lora_gru.pt` | Trained GRU + `Code2LoRAHead` weights (~2.85 GB, fp32). |
| `metrics.jsonl` | Per-step training metrics (loss, val EM/EditSim/CodeBLEU). |
## Training recipe
* 3 epochs of truncated BPTT (window K=16) on
`code2lora/code2lora-data-smartcap` (train QnAs) plus
`code2lora/code2lora-data-commits` (commit metadata + diff embeddings).
* AdamW + cosine schedule, max-seq-len 8192, bf16, single H100 80 GB.
## Companion model
`code2lora/code2lora-direct` -- the static-snapshot variant.
|