Sayood's picture
model card: E1b failure-gated CL-SFT (BOUND)
bc3ba92 verified
|
Raw
History Blame Contribute Delete
2.82 kB
---
license: other
license_name: physicalai-av-derived-research-only
tags:
- tanitad
- autonomous-driving
- anchored-diffusion
- planner
- closed-loop
- fine-tune
extra_gated_prompt: >-
These weights are trained on NVIDIA PhysicalAI-AV data (TanitAD research
program). Access is granted per request for research/evaluation use only;
you agree not to redistribute.
extra_gated_fields:
Name: text
Affiliation: text
Intended use: text
---
# TanitAD REF-C base β€” E1b failure-gated closed-loop SFT (research artifact)
**This checkpoint is a pre-registered `BOUND` result, not a deployed model.**
It is published for reproducibility and because it was the last single-disk
artifact of the E1b/E1c experiment line.
- **Base:** `Sayood/tanitad-refc-base` (REF-C anchored-diffusion planner,
104,191,577 params, 128 anchors, 2 denoise steps), step 29999.
- **Fine-tune:** 4000 steps, lr 2e-5, cosine, warmup 100, encoder **frozen**
(13,732,945 trainable / 90,458,632 frozen). Two interleaved objectives:
R2LPL-shaped anchor-score/traj supervision toward a logged-corridor *recovery*
demonstration at 3,537 mined recoverable pre-failure states, plus an
open-loop replay branch on the parity-train corpus.
- **Mining/replay corpus:** `physicalai-train-e438721ae894` (2376 episodes).
**Evaluation:** a byte-level-disjoint 44-episode held-out set.
## Measured (paired episode-cluster bootstrap, B=2000, over the held-out episodes)
| metric (K=185, 18.5 s closed loop) | base | this ckpt | paired delta |
|---|---|---|---|
| corridor-departure, overall | 0.5877 | 0.1603 | βˆ’0.4274 [βˆ’0.5161, βˆ’0.3378] **separated** |
| corridor-departure, junction | 0.8414 | 0.4144 | βˆ’0.4270 [βˆ’0.6838, βˆ’0.1648] **separated** |
| peak abs XTE (m) | 38.94 | 3.04 | βˆ’35.90 [βˆ’49.33, βˆ’24.12] **separated** |
| OOD peak ratio (in-band check) | 1.2664 | 1.1339 | βˆ’0.1325 **separated (favourable)** |
| open-loop guardrail (held-out) | base | this ckpt | paired delta |
|---|---|---|---|
| ADE@2s (m) | 0.4747 | 0.6693 | **+0.1947 [+0.1415, +0.2522] separated WORSE** |
| anchor accuracy | 0.6815 | 0.6163 | **βˆ’0.0651 separated WORSE** |
| anchor traj L1 | 0.1775 | 0.2399 | **+0.0624 separated WORSE** |
**Verdict: `BOUND`.** The pre-registration committed that a closed-loop win
bought with a CI-separated open-loop regression is *not* a success. The
diagnosed cause: the forgetting guard was monitored on the corpus it replays,
so it could only ever report success. E1c re-runs this configuration with the
guard on held-out data and reports the full frontier.
## Files
`ckpt.pt` (model + optimizer, step 3999) Β· `config.json` Β· `metrics.json` Β·
`train_log.jsonl`
**Not a safety claim.** The closed loop here is map/agent-free and measures
corridor-keeping/drift, not collision or off-road safety.