comp-gen-bench / README.md
mchlxo's picture
Document evaluation and result artifacts
ad7733c verified
|
Raw
History Blame Contribute Delete
879 Bytes
---
license: apache-2.0
library_name: pytorch
tags:
- domain-generalization
- disentanglement
- dsprites
---
# In-Domain Generalization Benchmark checkpoints
This repository stores checkpoints and resolved configurations produced by the
experiment pipeline in
[InDomainGeneralizationBenchmark](https://github.com/google-research/google-research/tree/master/in_domain_generalization).
Artifacts use this stable hierarchy:
```text
checkpoints/<experiment>/<dataset>/<split>/<model>/seed_<NN>/
β”œβ”€β”€ last.pt
β”œβ”€β”€ resolved_config.yaml
β”œβ”€β”€ status.yaml
└── evaluation/
β”œβ”€β”€ status.yaml
└── test_metrics.json
```
`last.pt` contains model and optimizer state so interrupted cluster jobs can be
resumed. `status.yaml` records metrics, completion state, and Slurm provenance.
Compact cross-seed result tables are stored under `results/`.