data/real_code2lora/repopeftbench-ood/README.md

---
license: mit
pretty_name: RepoPeftBench OOD holdout (static + evolution)
tags: [code, assertion-completion, repository-level, ood]
configs:
- config_name: commits
  data_files:
  - {split: ood_test, path: commits/ood_test.parquet}
- config_name: qna_static
  data_files:
  - {split: ood_test, path: qna_static/ood_test.parquet}
- config_name: qna_evo
  data_files:
  - {split: ood_test, path: qna_evo/ood_test.parquet}
---

# RepoPeftBench — OOD holdout (static + evolution)

Post-cutoff out-of-distribution repositories, holding both evaluation
views used in the paper's OOD table, post-cap and self-contained.

| config | split | rows | role |
|---|---|---:|---|
| commits | ood_test | 1,950 | per-commit diff + repo-state embeddings (GRU / anchor) |
| qna_static | ood_test | 9,942 | static-track prompts (prompt-based OOD rows) |
| qna_evo | ood_test | 14,813 | commit-derived capped eval (`<=8`/commit) |

```python
from datasets import load_dataset
commits    = load_dataset("code2lora/repopeftbench-ood", "commits")
qna_static = load_dataset("code2lora/repopeftbench-ood", "qna_static")
qna_evo    = load_dataset("code2lora/repopeftbench-ood", "qna_evo")
```

Companion datasets: `code2lora/code2lora-static`,
`code2lora/code2lora-evo`, `code2lora/code2lora-static-anchor`.