Elastic-forcing-code / 1.3B /docs /validation.md
Elastic-forcing's picture
Remove auxiliary records
5f90082 verified
|
Raw History Blame Contribute Delete
2.41 kB

Validation

The GPU results below describe commit 676d5a5ec9eb3cd65152b23826f028f388886dd5, before validation gates were removed. They were obtained on four NVIDIA H200 GPUs using the original three-encoder training assets. The gate-removal revision has separate CPU regression checks; it has not been rerun on GPUs.

Component Version
Python 3.10.12
PyTorch 2.5.1+cu121
torchvision 0.20.1+cu121
FlashAttention 2.7.4.post1
Transformers 4.53.3

Current CPU regression checks

After removing the launcher preflight gates, core reference checks, and selected encoder checks, all 15 retained CPU numerical tests passed. They cover MMD gradients, partial-batch normalization, feature sampling, and pixel-gradient accumulation. Tests that only enforced removed gates were retired. The current revision has not been rerun on GPUs.

Historical GPU checks

  • 31 CPU tests passed, covering MMD gradients, partial-batch normalization, feature contracts, pixel-gradient accumulation, and relocated reference identities.
  • One full-size optimizer update completed with 256 generated videos, 128 differentiated videos, and 128 sampled references on four workers. All 272 reference feature shards were validated during initialization.
  • The logged generator loss was 3.995 and the gradient norm before clipping was 44.62. The update was not skipped. DINOv3, V-JEPA 2, and VideoMAEv2 feature replay errors were all zero in this run.
  • Generator weights were finite, and the model, optimizer, and four per-worker random states were saved successfully. All 825 saved Adam parameter states recorded one update, and their gradients were not all zero.
  • The new checkpoint was loaded by the shared inference implementation and generated a decodable 81-frame, 832 × 480, 16 FPS video.

The run used bash scripts/train.sh --smoke. This overrides only the training length to one update; the distribution batch, differentiation batch, encoders, and reference assets remain those of the released recipe.

That revision included reference-content and relocation checks. These historical results should not be interpreted as validation of the current gate-removal changes.

This is an execution check. It does not repeat the 150-update training run, rerun VBench, establish minimum hardware requirements, or validate installation in a fresh environment.