Record six verified Figure 2 checkpoint uploads
Browse files- README.md +1 -1
- reports/latency-degradation-20261007/README.md +1 -1
- reports/latency-degradation-20261007/models/deadly-corridor/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/README.md +1 -1
- reports/latency-degradation-20261007/models/deadly-corridor/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/provenance.json +11 -3
- reports/latency-degradation-20261007/models/deadly-corridor/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/README.md +1 -1
- reports/latency-degradation-20261007/models/deadly-corridor/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/provenance.json +11 -3
- reports/latency-degradation-20261007/models/deadly-corridor/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2/README.md +1 -1
- reports/latency-degradation-20261007/models/deadly-corridor/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2/provenance.json +11 -3
- reports/latency-degradation-20261007/models/demon-attack/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6/README.md +1 -1
- reports/latency-degradation-20261007/models/demon-attack/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6/provenance.json +11 -3
- reports/latency-degradation-20261007/models/demon-attack/pi05_bridge_demon_attack_single_latency_clean_data_exp1/README.md +1 -1
- reports/latency-degradation-20261007/models/demon-attack/pi05_bridge_demon_attack_single_latency_clean_data_exp1/provenance.json +11 -3
- reports/latency-degradation-20261007/models/flappy/pi05_flappy_fix_latency_0_200ep/README.md +1 -1
- reports/latency-degradation-20261007/models/flappy/pi05_flappy_fix_latency_0_200ep/provenance.json +11 -3
- reports/latency-degradation-20261007/weight_reupload.json +99 -0
README.md
CHANGED
|
@@ -36,4 +36,4 @@ HAIC and Extreme Parkour releases are retired. Model bundles retain the publishe
|
|
| 36 |
|
| 37 |
## Figure 2 latency-degradation sources
|
| 38 |
|
| 39 |
-
[Checkpoint source bindings](reports/latency-degradation-20261007/README.md) identify the six original game checkpoints and the six reused MIKASA checkpoints.
|
|
|
|
| 36 |
|
| 37 |
## Figure 2 latency-degradation sources
|
| 38 |
|
| 39 |
+
[Checkpoint source bindings](reports/latency-degradation-20261007/README.md) identify the six original game checkpoints and the six reused MIKASA checkpoints. All six game checkpoints are published with their original SHA256 and size. The report records the missing Flappy GR00T step 3000 and two unconfirmed OpenVLA bindings.
|
reports/latency-degradation-20261007/README.md
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
# Figure 2 checkpoint source bindings
|
| 2 |
|
| 3 |
-
Six game checkpoints have confirmed source bindings.
|
| 4 |
|
| 5 |
[Evaluation archive](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/tree/efeac490144ca9c94660e2410163415e0a8809a9/experiments/latency-degradation/paper). Numerical figure inputs are unchanged. Runtime loading was not repeated.
|
|
|
|
| 1 |
# Figure 2 checkpoint source bindings
|
| 2 |
|
| 3 |
+
Six game checkpoints have confirmed source bindings. All six are now published in benchmark-models with unchanged SHA256 and size; [upload receipts](weight_reupload.json) pin each central checkpoint. Original weights remain at fixed source revisions. Six MIKASA checkpoints already exist in the central repository and are reused. Flappy GR00T step 3000 is missing in its source's main and audited history. The Flappy and Demon OpenVLA curves have unconfirmed checkpoint bindings.
|
| 4 |
|
| 5 |
[Evaluation archive](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/tree/efeac490144ca9c94660e2410163415e0a8809a9/experiments/latency-degradation/paper). Numerical figure inputs are unchanged. Runtime loading was not repeated.
|
reports/latency-degradation-20261007/models/deadly-corridor/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/README.md
CHANGED
|
@@ -4,6 +4,6 @@ The curve uses optimizer step 500. The original evaluation JSON matches the pape
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2@e93458b10c98dd1f4c712071a74f46dda2fa905d`, path `steps_500_state/model.safetensors`. SHA256: `6e4b8e4858ee32c19303680674afa8dfd22eaf8fab4e90842acf29358102cff6`.
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/deadly-corridor/latency-degradation/qwengr00t/step_500.json).
|
|
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2@e93458b10c98dd1f4c712071a74f46dda2fa905d`, path `steps_500_state/model.safetensors`. SHA256: `6e4b8e4858ee32c19303680674afa8dfd22eaf8fab4e90842acf29358102cff6`.
|
| 6 |
|
| 7 |
+
The [central checkpoint](https://huggingface.co/latency-sensitive-bench/benchmark-models/blob/e1649b2fa90d2bb63cd46e108d5b2f3f93ec8cf6/zero-latency/deadly-corridor/vla/starvla-qwengr00t-h1/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/checkpoints/steps_500_model.safetensors) is published with unchanged SHA256 and size. This directory contains provenance and the original metadata available from the source. It does not contain a checkpoint. Runtime loading was not verified.
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/deadly-corridor/latency-degradation/qwengr00t/step_500.json).
|
reports/latency-degradation-20261007/models/deadly-corridor/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/provenance.json
CHANGED
|
@@ -21,8 +21,8 @@
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
-
"central_checkpoint_status": "
|
| 25 |
-
"central_checkpoint_committed":
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
@@ -32,5 +32,13 @@
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
-
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
}
|
|
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
+
"central_checkpoint_status": "published",
|
| 25 |
+
"central_checkpoint_committed": true,
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
+
],
|
| 36 |
+
"central_checkpoint": {
|
| 37 |
+
"repo": "latency-sensitive-bench/benchmark-models",
|
| 38 |
+
"repo_type": "model",
|
| 39 |
+
"revision": "e1649b2fa90d2bb63cd46e108d5b2f3f93ec8cf6",
|
| 40 |
+
"path": "zero-latency/deadly-corridor/vla/starvla-qwengr00t-h1/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/checkpoints/steps_500_model.safetensors",
|
| 41 |
+
"sha256": "6e4b8e4858ee32c19303680674afa8dfd22eaf8fab4e90842acf29358102cff6",
|
| 42 |
+
"size": 9521659380
|
| 43 |
+
}
|
| 44 |
}
|
reports/latency-degradation-20261007/models/deadly-corridor/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/README.md
CHANGED
|
@@ -4,6 +4,6 @@ The curve uses optimizer step 500. The original evaluation JSON matches the pape
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2@31983a233371ba1e755e28b38de3b0b72ded39f7`, path `steps_500_state/model.safetensors`. SHA256: `c6293db2208230c4caa45484b185d417babe948ac5222a600aa9fc62589056a5`.
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/deadly-corridor/latency-degradation/qwenoft/step_500.json).
|
|
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2@31983a233371ba1e755e28b38de3b0b72ded39f7`, path `steps_500_state/model.safetensors`. SHA256: `c6293db2208230c4caa45484b185d417babe948ac5222a600aa9fc62589056a5`.
|
| 6 |
|
| 7 |
+
The [central checkpoint](https://huggingface.co/latency-sensitive-bench/benchmark-models/blob/dd61b7ddf3b94d8661b442f382dce50e59e28fc4/zero-latency/deadly-corridor/vla/starvla-qwenoft-h1/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/checkpoints/steps_500_model.safetensors) is published with unchanged SHA256 and size. This directory contains provenance and the original metadata available from the source. It does not contain a checkpoint. Runtime loading was not verified.
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/deadly-corridor/latency-degradation/qwenoft/step_500.json).
|
reports/latency-degradation-20261007/models/deadly-corridor/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/provenance.json
CHANGED
|
@@ -21,8 +21,8 @@
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
-
"central_checkpoint_status": "
|
| 25 |
-
"central_checkpoint_committed":
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
@@ -32,5 +32,13 @@
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
-
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
}
|
|
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
+
"central_checkpoint_status": "published",
|
| 25 |
+
"central_checkpoint_committed": true,
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
+
],
|
| 36 |
+
"central_checkpoint": {
|
| 37 |
+
"repo": "latency-sensitive-bench/benchmark-models",
|
| 38 |
+
"repo_type": "model",
|
| 39 |
+
"revision": "dd61b7ddf3b94d8661b442f382dce50e59e28fc4",
|
| 40 |
+
"path": "zero-latency/deadly-corridor/vla/starvla-qwenoft-h1/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/checkpoints/steps_500_model.safetensors",
|
| 41 |
+
"sha256": "c6293db2208230c4caa45484b185d417babe948ac5222a600aa9fc62589056a5",
|
| 42 |
+
"size": 9138230516
|
| 43 |
+
}
|
| 44 |
}
|
reports/latency-degradation-20261007/models/deadly-corridor/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2/README.md
CHANGED
|
@@ -4,6 +4,6 @@ The curve uses optimizer step 500. The original evaluation JSON matches the pape
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2@4d80b52ab5160e20327c843d7737c25ecfcb5ec7`, path `steps_500_state/model.safetensors`. SHA256: `171da5334fbd3a5c9d2b581de32dfd0a06165af73ffca77413fcf70fe96d0945`.
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/deadly-corridor/latency-degradation/qwenpi_v3/step_500.json).
|
|
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2@4d80b52ab5160e20327c843d7737c25ecfcb5ec7`, path `steps_500_state/model.safetensors`. SHA256: `171da5334fbd3a5c9d2b581de32dfd0a06165af73ffca77413fcf70fe96d0945`.
|
| 6 |
|
| 7 |
+
The [central checkpoint](https://huggingface.co/latency-sensitive-bench/benchmark-models/blob/90e1c5a4fa2775fc066b103432e8eb37181de6f6/zero-latency/deadly-corridor/vla/starvla-qwenpi_v3-h1/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2/checkpoints/steps_500_model.safetensors) is published with unchanged SHA256 and size. This directory contains provenance and the original metadata available from the source. It does not contain a checkpoint. Runtime loading was not verified.
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/deadly-corridor/latency-degradation/qwenpi_v3/step_500.json).
|
reports/latency-degradation-20261007/models/deadly-corridor/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2/provenance.json
CHANGED
|
@@ -21,8 +21,8 @@
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
-
"central_checkpoint_status": "
|
| 25 |
-
"central_checkpoint_committed":
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
@@ -32,5 +32,13 @@
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
-
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
}
|
|
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
+
"central_checkpoint_status": "published",
|
| 25 |
+
"central_checkpoint_committed": true,
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
+
],
|
| 36 |
+
"central_checkpoint": {
|
| 37 |
+
"repo": "latency-sensitive-bench/benchmark-models",
|
| 38 |
+
"repo_type": "model",
|
| 39 |
+
"revision": "90e1c5a4fa2775fc066b103432e8eb37181de6f6",
|
| 40 |
+
"path": "zero-latency/deadly-corridor/vla/starvla-qwenpi_v3-h1/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2/checkpoints/steps_500_model.safetensors",
|
| 41 |
+
"sha256": "171da5334fbd3a5c9d2b581de32dfd0a06165af73ffca77413fcf70fe96d0945",
|
| 42 |
+
"size": 11412998004
|
| 43 |
+
}
|
| 44 |
}
|
reports/latency-degradation-20261007/models/demon-attack/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6/README.md
CHANGED
|
@@ -4,6 +4,6 @@ The curve uses optimizer step 5000. The original evaluation JSON matches the pap
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `latency-sensitive-bench/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6@fb0b8c4ef4d76b8c7ad97edf4990341f2b93cf70`, path `checkpoints/steps_5000_model.safetensors`. SHA256: `adb7a7b841e0495b5f18a081184a8960a6817c2468645c673f8ac1c090c06cd9`.
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/demon-attack/latency-degradation/qwengr00t/step_5000.json).
|
|
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `latency-sensitive-bench/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6@fb0b8c4ef4d76b8c7ad97edf4990341f2b93cf70`, path `checkpoints/steps_5000_model.safetensors`. SHA256: `adb7a7b841e0495b5f18a081184a8960a6817c2468645c673f8ac1c090c06cd9`.
|
| 6 |
|
| 7 |
+
The [central checkpoint](https://huggingface.co/latency-sensitive-bench/benchmark-models/blob/11190ac2d7c41c352237f6a94b35413b00bfba8f/zero-latency/demon-attack/vla/starvla-qwengr00t-h1/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6/checkpoints/steps_5000_model.safetensors) is published with unchanged SHA256 and size. This directory contains provenance and the original metadata available from the source. It does not contain a checkpoint. Runtime loading was not verified.
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/demon-attack/latency-degradation/qwengr00t/step_5000.json).
|
reports/latency-degradation-20261007/models/demon-attack/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6/provenance.json
CHANGED
|
@@ -26,13 +26,21 @@
|
|
| 26 |
"dataset_statistics_eval.json"
|
| 27 |
],
|
| 28 |
"runtime_loading_verified": false,
|
| 29 |
-
"central_checkpoint_status": "
|
| 30 |
-
"central_checkpoint_committed":
|
| 31 |
"central_evaluation": {
|
| 32 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 33 |
"repo_type": "dataset",
|
| 34 |
"revision": "efeac490144ca9c94660e2410163415e0a8809a9",
|
| 35 |
"path": "evaluations/demon-attack/latency-degradation/qwengr00t/step_5000.json"
|
| 36 |
},
|
| 37 |
-
"original_metadata_missing": []
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
}
|
|
|
|
| 26 |
"dataset_statistics_eval.json"
|
| 27 |
],
|
| 28 |
"runtime_loading_verified": false,
|
| 29 |
+
"central_checkpoint_status": "published",
|
| 30 |
+
"central_checkpoint_committed": true,
|
| 31 |
"central_evaluation": {
|
| 32 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 33 |
"repo_type": "dataset",
|
| 34 |
"revision": "efeac490144ca9c94660e2410163415e0a8809a9",
|
| 35 |
"path": "evaluations/demon-attack/latency-degradation/qwengr00t/step_5000.json"
|
| 36 |
},
|
| 37 |
+
"original_metadata_missing": [],
|
| 38 |
+
"central_checkpoint": {
|
| 39 |
+
"repo": "latency-sensitive-bench/benchmark-models",
|
| 40 |
+
"repo_type": "model",
|
| 41 |
+
"revision": "11190ac2d7c41c352237f6a94b35413b00bfba8f",
|
| 42 |
+
"path": "zero-latency/demon-attack/vla/starvla-qwengr00t-h1/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6/checkpoints/steps_5000_model.safetensors",
|
| 43 |
+
"sha256": "adb7a7b841e0495b5f18a081184a8960a6817c2468645c673f8ac1c090c06cd9",
|
| 44 |
+
"size": 9521659380
|
| 45 |
+
}
|
| 46 |
}
|
reports/latency-degradation-20261007/models/demon-attack/pi05_bridge_demon_attack_single_latency_clean_data_exp1/README.md
CHANGED
|
@@ -4,6 +4,6 @@ The curve uses optimizer step 5000. The original evaluation JSON matches the pap
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/pi05_bridge_demon_attack_single_latency_clean_data_exp1@66966cf0ba7889f447b031aa33b865d3ada419da`, path `steps_5000_state/model.safetensors`. SHA256: `168cab931db1793c763bdcf454c8b8bf6817221d150e980c7ec15c42adf64c2f`.
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/demon-attack/latency-degradation/qwenpi_v3/step_5000.json).
|
|
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `talha15032/pi05_bridge_demon_attack_single_latency_clean_data_exp1@66966cf0ba7889f447b031aa33b865d3ada419da`, path `steps_5000_state/model.safetensors`. SHA256: `168cab931db1793c763bdcf454c8b8bf6817221d150e980c7ec15c42adf64c2f`.
|
| 6 |
|
| 7 |
+
The [central checkpoint](https://huggingface.co/latency-sensitive-bench/benchmark-models/blob/66e868f281a07b6858ce46af7b2d0b8788122f1f/zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/pi05_bridge_demon_attack_single_latency_clean_data_exp1/checkpoints/steps_5000_model.safetensors) is published with unchanged SHA256 and size. This directory contains provenance and the original metadata available from the source. It does not contain a checkpoint. Runtime loading was not verified.
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/demon-attack/latency-degradation/qwenpi_v3/step_5000.json).
|
reports/latency-degradation-20261007/models/demon-attack/pi05_bridge_demon_attack_single_latency_clean_data_exp1/provenance.json
CHANGED
|
@@ -21,8 +21,8 @@
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
-
"central_checkpoint_status": "
|
| 25 |
-
"central_checkpoint_committed":
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
@@ -32,5 +32,13 @@
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
-
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
}
|
|
|
|
| 21 |
},
|
| 22 |
"available_metadata": [],
|
| 23 |
"runtime_loading_verified": false,
|
| 24 |
+
"central_checkpoint_status": "published",
|
| 25 |
+
"central_checkpoint_committed": true,
|
| 26 |
"central_evaluation": {
|
| 27 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 28 |
"repo_type": "dataset",
|
|
|
|
| 32 |
"original_metadata_missing": [
|
| 33 |
"config.full.yaml",
|
| 34 |
"dataset_statistics.json"
|
| 35 |
+
],
|
| 36 |
+
"central_checkpoint": {
|
| 37 |
+
"repo": "latency-sensitive-bench/benchmark-models",
|
| 38 |
+
"repo_type": "model",
|
| 39 |
+
"revision": "66e868f281a07b6858ce46af7b2d0b8788122f1f",
|
| 40 |
+
"path": "zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/pi05_bridge_demon_attack_single_latency_clean_data_exp1/checkpoints/steps_5000_model.safetensors",
|
| 41 |
+
"sha256": "168cab931db1793c763bdcf454c8b8bf6817221d150e980c7ec15c42adf64c2f",
|
| 42 |
+
"size": 11412998004
|
| 43 |
+
}
|
| 44 |
}
|
reports/latency-degradation-20261007/models/flappy/pi05_flappy_fix_latency_0_200ep/README.md
CHANGED
|
@@ -4,6 +4,6 @@ The curve uses optimizer step 5000. The original evaluation JSON matches the pap
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `latency-sensitive-bench/pi05_fix_latency@d7c75396e88ae9be7f6988869031a2c438bbc54d`, path `pi05_flappy_fix_latency_0_200ep/checkpoints/steps_5000_state/model.safetensors`. SHA256: `c7e7d86dda1257b48f0465818e7d6186c781e92bbd4f1365eae2a9eed215c942`.
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/flappy/latency-degradation/qwenpi_v3/step_5000.json).
|
|
|
|
| 4 |
|
| 5 |
The exact checkpoint remains in `latency-sensitive-bench/pi05_fix_latency@d7c75396e88ae9be7f6988869031a2c438bbc54d`, path `pi05_flappy_fix_latency_0_200ep/checkpoints/steps_5000_state/model.safetensors`. SHA256: `c7e7d86dda1257b48f0465818e7d6186c781e92bbd4f1365eae2a9eed215c942`.
|
| 6 |
|
| 7 |
+
The [central checkpoint](https://huggingface.co/latency-sensitive-bench/benchmark-models/blob/517c9e9466a3f9ee99c2f1f729419ab2b3c2efaf/zero-latency/flappy/vla/starvla-qwenpi_v3-h1/pi05_flappy_fix_latency_0_200ep/checkpoints/steps_5000_model.safetensors) is published with unchanged SHA256 and size. This directory contains provenance and the original metadata available from the source. It does not contain a checkpoint. Runtime loading was not verified.
|
| 8 |
|
| 9 |
[Fixed evaluation](https://huggingface.co/datasets/latency-sensitive-bench/benchmark-datasets/blob/efeac490144ca9c94660e2410163415e0a8809a9/evaluations/flappy/latency-degradation/qwenpi_v3/step_5000.json).
|
reports/latency-degradation-20261007/models/flappy/pi05_flappy_fix_latency_0_200ep/provenance.json
CHANGED
|
@@ -27,13 +27,21 @@
|
|
| 27 |
],
|
| 28 |
"runtime_loading_verified": false,
|
| 29 |
"evaluation_weight_sha256_equal": true,
|
| 30 |
-
"central_checkpoint_status": "
|
| 31 |
-
"central_checkpoint_committed":
|
| 32 |
"central_evaluation": {
|
| 33 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 34 |
"repo_type": "dataset",
|
| 35 |
"revision": "efeac490144ca9c94660e2410163415e0a8809a9",
|
| 36 |
"path": "evaluations/flappy/latency-degradation/qwenpi_v3/step_5000.json"
|
| 37 |
},
|
| 38 |
-
"original_metadata_missing": []
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
}
|
|
|
|
| 27 |
],
|
| 28 |
"runtime_loading_verified": false,
|
| 29 |
"evaluation_weight_sha256_equal": true,
|
| 30 |
+
"central_checkpoint_status": "published",
|
| 31 |
+
"central_checkpoint_committed": true,
|
| 32 |
"central_evaluation": {
|
| 33 |
"repo": "latency-sensitive-bench/benchmark-datasets",
|
| 34 |
"repo_type": "dataset",
|
| 35 |
"revision": "efeac490144ca9c94660e2410163415e0a8809a9",
|
| 36 |
"path": "evaluations/flappy/latency-degradation/qwenpi_v3/step_5000.json"
|
| 37 |
},
|
| 38 |
+
"original_metadata_missing": [],
|
| 39 |
+
"central_checkpoint": {
|
| 40 |
+
"repo": "latency-sensitive-bench/benchmark-models",
|
| 41 |
+
"repo_type": "model",
|
| 42 |
+
"revision": "517c9e9466a3f9ee99c2f1f729419ab2b3c2efaf",
|
| 43 |
+
"path": "zero-latency/flappy/vla/starvla-qwenpi_v3-h1/pi05_flappy_fix_latency_0_200ep/checkpoints/steps_5000_model.safetensors",
|
| 44 |
+
"sha256": "c7e7d86dda1257b48f0465818e7d6186c781e92bbd4f1365eae2a9eed215c942",
|
| 45 |
+
"size": 11412998004
|
| 46 |
+
}
|
| 47 |
}
|
reports/latency-degradation-20261007/weight_reupload.json
ADDED
|
@@ -0,0 +1,99 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"date": "2026-10-08",
|
| 3 |
+
"checkpoints": [
|
| 4 |
+
{
|
| 5 |
+
"index": 0,
|
| 6 |
+
"source_repo": "latency-sensitive-bench/pi05_fix_latency",
|
| 7 |
+
"source_revision": "d7c75396e88ae9be7f6988869031a2c438bbc54d",
|
| 8 |
+
"source_path": "pi05_flappy_fix_latency_0_200ep/checkpoints/steps_5000_state/model.safetensors",
|
| 9 |
+
"destination_repo": "latency-sensitive-bench/benchmark-models",
|
| 10 |
+
"destination_path": "zero-latency/flappy/vla/starvla-qwenpi_v3-h1/pi05_flappy_fix_latency_0_200ep/checkpoints/steps_5000_model.safetensors",
|
| 11 |
+
"revision": "517c9e9466a3f9ee99c2f1f729419ab2b3c2efaf",
|
| 12 |
+
"commit_url": "https://huggingface.co/latency-sensitive-bench/benchmark-models/commit/517c9e9466a3f9ee99c2f1f729419ab2b3c2efaf",
|
| 13 |
+
"sha256": "c7e7d86dda1257b48f0465818e7d6186c781e92bbd4f1365eae2a9eed215c942",
|
| 14 |
+
"size": 11412998004,
|
| 15 |
+
"content_unchanged": true,
|
| 16 |
+
"upload_method": "HfApi.upload_file with hf_xet enabled",
|
| 17 |
+
"remote_identity_verified": true
|
| 18 |
+
},
|
| 19 |
+
{
|
| 20 |
+
"index": 1,
|
| 21 |
+
"source_repo": "talha15032/pi05_bridge_demon_attack_single_latency_clean_data_exp1",
|
| 22 |
+
"source_revision": "66966cf0ba7889f447b031aa33b865d3ada419da",
|
| 23 |
+
"source_path": "steps_5000_state/model.safetensors",
|
| 24 |
+
"destination_repo": "latency-sensitive-bench/benchmark-models",
|
| 25 |
+
"destination_path": "zero-latency/demon-attack/vla/starvla-qwenpi_v3-h1/pi05_bridge_demon_attack_single_latency_clean_data_exp1/checkpoints/steps_5000_model.safetensors",
|
| 26 |
+
"revision": "66e868f281a07b6858ce46af7b2d0b8788122f1f",
|
| 27 |
+
"commit_url": "https://huggingface.co/latency-sensitive-bench/benchmark-models/commit/66e868f281a07b6858ce46af7b2d0b8788122f1f",
|
| 28 |
+
"sha256": "168cab931db1793c763bdcf454c8b8bf6817221d150e980c7ec15c42adf64c2f",
|
| 29 |
+
"size": 11412998004,
|
| 30 |
+
"content_unchanged": true,
|
| 31 |
+
"upload_method": "HfApi.upload_file with hf_xet enabled",
|
| 32 |
+
"remote_identity_verified": true
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"index": 2,
|
| 36 |
+
"source_repo": "latency-sensitive-bench/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6",
|
| 37 |
+
"source_revision": "fb0b8c4ef4d76b8c7ad97edf4990341f2b93cf70",
|
| 38 |
+
"source_path": "checkpoints/steps_5000_model.safetensors",
|
| 39 |
+
"destination_repo": "latency-sensitive-bench/benchmark-models",
|
| 40 |
+
"destination_path": "zero-latency/demon-attack/vla/starvla-qwengr00t-h1/gr00t_bridge_demon_attack_single_latency_clean_data_exp3_action_1e-5_backbone_1e-6/checkpoints/steps_5000_model.safetensors",
|
| 41 |
+
"revision": "11190ac2d7c41c352237f6a94b35413b00bfba8f",
|
| 42 |
+
"commit_url": "https://huggingface.co/latency-sensitive-bench/benchmark-models/commit/11190ac2d7c41c352237f6a94b35413b00bfba8f",
|
| 43 |
+
"sha256": "adb7a7b841e0495b5f18a081184a8960a6817c2468645c673f8ac1c090c06cd9",
|
| 44 |
+
"size": 9521659380,
|
| 45 |
+
"content_unchanged": true,
|
| 46 |
+
"upload_method": "HfApi.upload_file with hf_xet enabled",
|
| 47 |
+
"remote_identity_verified": true
|
| 48 |
+
},
|
| 49 |
+
{
|
| 50 |
+
"index": 3,
|
| 51 |
+
"source_repo": "talha15032/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2",
|
| 52 |
+
"source_revision": "31983a233371ba1e755e28b38de3b0b72ded39f7",
|
| 53 |
+
"source_path": "steps_500_state/model.safetensors",
|
| 54 |
+
"destination_repo": "latency-sensitive-bench/benchmark-models",
|
| 55 |
+
"destination_path": "zero-latency/deadly-corridor/vla/starvla-qwenoft-h1/openvla_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/checkpoints/steps_500_model.safetensors",
|
| 56 |
+
"revision": "dd61b7ddf3b94d8661b442f382dce50e59e28fc4",
|
| 57 |
+
"commit_url": "https://huggingface.co/latency-sensitive-bench/benchmark-models/commit/dd61b7ddf3b94d8661b442f382dce50e59e28fc4",
|
| 58 |
+
"sha256": "c6293db2208230c4caa45484b185d417babe948ac5222a600aa9fc62589056a5",
|
| 59 |
+
"size": 9138230516,
|
| 60 |
+
"content_unchanged": true,
|
| 61 |
+
"upload_method": "HfApi.upload_file with hf_xet enabled",
|
| 62 |
+
"remote_identity_verified": true
|
| 63 |
+
},
|
| 64 |
+
{
|
| 65 |
+
"index": 4,
|
| 66 |
+
"source_repo": "talha15032/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2",
|
| 67 |
+
"source_revision": "4d80b52ab5160e20327c843d7737c25ecfcb5ec7",
|
| 68 |
+
"source_path": "steps_500_state/model.safetensors",
|
| 69 |
+
"destination_repo": "latency-sensitive-bench/benchmark-models",
|
| 70 |
+
"destination_path": "zero-latency/deadly-corridor/vla/starvla-qwenpi_v3-h1/pi05_bridge_deadly_corridor_single_latency_clean_data_exp2/checkpoints/steps_500_model.safetensors",
|
| 71 |
+
"revision": "90e1c5a4fa2775fc066b103432e8eb37181de6f6",
|
| 72 |
+
"commit_url": "https://huggingface.co/latency-sensitive-bench/benchmark-models/commit/90e1c5a4fa2775fc066b103432e8eb37181de6f6",
|
| 73 |
+
"sha256": "171da5334fbd3a5c9d2b581de32dfd0a06165af73ffca77413fcf70fe96d0945",
|
| 74 |
+
"size": 11412998004,
|
| 75 |
+
"content_unchanged": true,
|
| 76 |
+
"upload_method": "HfApi.upload_file with hf_xet enabled",
|
| 77 |
+
"remote_identity_verified": true
|
| 78 |
+
},
|
| 79 |
+
{
|
| 80 |
+
"index": 5,
|
| 81 |
+
"source_repo": "talha15032/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2",
|
| 82 |
+
"source_revision": "e93458b10c98dd1f4c712071a74f46dda2fa905d",
|
| 83 |
+
"source_path": "steps_500_state/model.safetensors",
|
| 84 |
+
"destination_repo": "latency-sensitive-bench/benchmark-models",
|
| 85 |
+
"destination_path": "zero-latency/deadly-corridor/vla/starvla-qwengr00t-h1/gr00t_bridge_deadly_corridor_single_latency_clean_data_bce_exp2/checkpoints/steps_500_model.safetensors",
|
| 86 |
+
"revision": "e1649b2fa90d2bb63cd46e108d5b2f3f93ec8cf6",
|
| 87 |
+
"commit_url": "https://huggingface.co/latency-sensitive-bench/benchmark-models/commit/e1649b2fa90d2bb63cd46e108d5b2f3f93ec8cf6",
|
| 88 |
+
"sha256": "6e4b8e4858ee32c19303680674afa8dfd22eaf8fab4e90842acf29358102cff6",
|
| 89 |
+
"size": 9521659380,
|
| 90 |
+
"content_unchanged": true,
|
| 91 |
+
"upload_method": "HfApi.upload_file with hf_xet enabled",
|
| 92 |
+
"remote_identity_verified": true
|
| 93 |
+
}
|
| 94 |
+
],
|
| 95 |
+
"total_bytes": 62420543288,
|
| 96 |
+
"content_unchanged": true,
|
| 97 |
+
"source_repositories_deleted": 0,
|
| 98 |
+
"runtime_loading_verified": false
|
| 99 |
+
}
|