comp-gen-bench / README.md
mchlxo's picture
Document evaluation and result artifacts
ad7733c verified
|
Raw
History Blame Contribute Delete
879 Bytes
metadata
license: apache-2.0
library_name: pytorch
tags:
  - domain-generalization
  - disentanglement
  - dsprites

In-Domain Generalization Benchmark checkpoints

This repository stores checkpoints and resolved configurations produced by the experiment pipeline in InDomainGeneralizationBenchmark.

Artifacts use this stable hierarchy:

checkpoints/<experiment>/<dataset>/<split>/<model>/seed_<NN>/
β”œβ”€β”€ last.pt
β”œβ”€β”€ resolved_config.yaml
β”œβ”€β”€ status.yaml
└── evaluation/
    β”œβ”€β”€ status.yaml
    └── test_metrics.json

last.pt contains model and optimizer state so interrupted cluster jobs can be resumed. status.yaml records metrics, completion state, and Slurm provenance. Compact cross-seed result tables are stored under results/.