Clean up Isaac 0.5 model card placeholders
Browse files
README.md
CHANGED
|
@@ -18,7 +18,7 @@ Isaac 0.5 brings multimodal video understanding, embodied reasoning, spatial gro
|
|
| 18 |
|
| 19 |
To our knowledge, Isaac 0.5 is the first open model operating at the frontier of multimodal video understanding, embodied reasoning, and robot control.
|
| 20 |
|
| 21 |
-
**[Read the paper](REPORT LINK) · [Download the weights](
|
| 22 |
|
| 23 |
## Extending the frontier of open robot learning
|
| 24 |
|
|
@@ -64,7 +64,7 @@ $$
|
|
| 64 |
L_{\text{percept}} = \mathbb{E}\left[\ell\left(g_\theta(o_{\leq t}), z_{t+\Delta}\right)\right]
|
| 65 |
$$
|
| 66 |
|
| 67 |
-
Here,
|
| 68 |
|
| 69 |
## Model architecture
|
| 70 |
|
|
@@ -88,11 +88,6 @@ Training examples are packed into 16,384-token sequences with 2% padding across
|
|
| 88 |
|
| 89 |
We evaluate the same Isaac checkpoints across multimodal video understanding, spatial grounding, held-out action prediction, and closed-loop robot control.
|
| 90 |
|
| 91 |
-
- **Video understanding:** [TK-VIDEO RESULT] on [TK-VIDEO EVALUATION]
|
| 92 |
-
- **Pointing:** [TK-POINTING RESULT] on [TK-POINTING EVALUATION]
|
| 93 |
-
- **Tracking:** [TK-TRACKING RESULT] on [TK-TRACKING EVALUATION]
|
| 94 |
-
- **Closed-loop control:** [TK-HEADLINE-RESULT] across [TK-TASKS] standard manipulation tasks under the released protocol
|
| 95 |
-
|
| 96 |

|
| 97 |
|
| 98 |
*Up and to the left is better. Ringed Isaac 0.5 results sit on the frontier; hollow markers are dominated.*
|
|
@@ -144,11 +139,9 @@ The release includes:
|
|
| 144 |
|
| 145 |
## Resources
|
| 146 |
|
| 147 |
-
- **Weights:** [Hugging Face](
|
| 148 |
- **Code:** [GitHub](GITHUB LINK)
|
| 149 |
- **Technical report:** [Read the paper](REPORT LINK)
|
| 150 |
-
- **Results and rollouts:** [View results](RESULTS LINK)
|
| 151 |
-
- **Reproduction guide:** [View guide](REPRODUCTION GUIDE LINK)
|
| 152 |
|
| 153 |
Open models are essential to robotics progress. We are releasing Isaac 0.5 with its weights, code, interfaces, benchmarks, and manifests so others can inspect, reproduce, and extend the work.
|
| 154 |
|
|
|
|
| 18 |
|
| 19 |
To our knowledge, Isaac 0.5 is the first open model operating at the frontier of multimodal video understanding, embodied reasoning, and robot control.
|
| 20 |
|
| 21 |
+
**[Read the paper](REPORT LINK) · [Download the weights](https://huggingface.co/PerceptronAI/Isaac-0.5) · [View the code](GITHUB LINK)**
|
| 22 |
|
| 23 |
## Extending the frontier of open robot learning
|
| 24 |
|
|
|
|
| 64 |
L_{\text{percept}} = \mathbb{E}\left[\ell\left(g_\theta(o_{\leq t}), z_{t+\Delta}\right)\right]
|
| 65 |
$$
|
| 66 |
|
| 67 |
+
Here, `o≤t` is the observation history and `z(t + Δ)` is the future percept. This objective trains the same backbone Isaac uses to produce actions.
|
| 68 |
|
| 69 |
## Model architecture
|
| 70 |
|
|
|
|
| 88 |
|
| 89 |
We evaluate the same Isaac checkpoints across multimodal video understanding, spatial grounding, held-out action prediction, and closed-loop robot control.
|
| 90 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 91 |

|
| 92 |
|
| 93 |
*Up and to the left is better. Ringed Isaac 0.5 results sit on the frontier; hollow markers are dominated.*
|
|
|
|
| 139 |
|
| 140 |
## Resources
|
| 141 |
|
| 142 |
+
- **Weights:** [Hugging Face](https://huggingface.co/PerceptronAI/Isaac-0.5)
|
| 143 |
- **Code:** [GitHub](GITHUB LINK)
|
| 144 |
- **Technical report:** [Read the paper](REPORT LINK)
|
|
|
|
|
|
|
| 145 |
|
| 146 |
Open models are essential to robotics progress. We are releasing Isaac 0.5 with its weights, code, interfaces, benchmarks, and manifests so others can inspect, reproduce, and extend the work.
|
| 147 |
|