Trim Isaac 0.5 model card sections
Browse files
README.md
CHANGED
|
@@ -76,14 +76,6 @@ Each mixture-of-experts layer gives every token access to 256 learned experts an
|
|
| 76 |
|
| 77 |

|
| 78 |
|
| 79 |
-
## Training system
|
| 80 |
-
|
| 81 |
-
mHarmony, our typed input compiler, converts every data source into one stream of text, vision, time, state, and action events while preserving provenance. Isaac uses the same format in training and serving.
|
| 82 |
-
|
| 83 |
-
Training examples are packed into 16,384-token sequences with 2% padding across the full mixture. Video is decoded outside the training process so corrupted files can restart without interrupting a run. Visual blocks are distributed across workers before encoding to prevent one long video from slowing an entire step. The released hyper-sparse configuration reaches 24% model FLOP utilization.
|
| 84 |
-
|
| 85 |
-

|
| 86 |
-
|
| 87 |
## Performance benchmarks
|
| 88 |
|
| 89 |
We evaluate the same Isaac checkpoints across multimodal video understanding, spatial grounding, held-out action prediction, and closed-loop robot control.
|
|
@@ -92,18 +84,6 @@ We evaluate the same Isaac checkpoints across multimodal video understanding, sp
|
|
| 92 |
|
| 93 |
*Up and to the left is better. Ringed Isaac 0.5 results sit on the frontier; hollow markers are dominated.*
|
| 94 |
|
| 95 |
-
## Robot-control evaluation
|
| 96 |
-
|
| 97 |
-
Our YAM-native simulation and data engine is built around MolmoSpaces. It spans five hardware revisions and four grippers, producing 20 arm-and-gripper configurations with one common observation and action interface. Reach, joint limits, contact geometry, force limits, calibration, and collision envelopes remain specific to each configuration.
|
| 98 |
-
|
| 99 |
-
The current zero-shot suite contains 42 tasks across nine manipulation families, including object interaction, spatial rearrangement, articulation, insertion, tool use, and multistage tasks. Compound tasks run continuously across subgoals, and grasp outcomes require valid contact with a stable object.
|
| 100 |
-
|
| 101 |
-
We vary placement, lighting, instruction wording, and distractors while keeping each task and scorer fixed. Alongside task success, we report completion time, path length, jerk, collisions, slips, controller saturation, and safety interventions. Timeouts, invalid actions, dropped observations, and controller faults count as failures.
|
| 102 |
-
|
| 103 |
-
Simulation provides repeatable coverage. Physical trials measure deployment directly. Where possible, we pair both and hold out complete robot families to measure transfer before hardware-specific adaptation. LIBERO and SIMPLER provide additional standardized comparisons under matched observations, instructions, action horizons, controllers, and serving paths.
|
| 104 |
-
|
| 105 |
-

|
| 106 |
-
|
| 107 |
## Where Isaac sits among open models
|
| 108 |
|
| 109 |
| Model | Robot training scope | Obs. steps | RTC-trained | Prev. actions | Mistake modeling | Non-robot video | Flow expert | Open source |
|
|
@@ -133,10 +113,6 @@ The release includes:
|
|
| 133 |
- checkpoint, data, and model-I/O manifests;
|
| 134 |
- the technical report, model card, and reproduction guide.
|
| 135 |
|
| 136 |
-
### Usage
|
| 137 |
-
|
| 138 |
-
> **[TODO: Add final installation command and checkpoint-specific inference example.]**
|
| 139 |
-
|
| 140 |
## Resources
|
| 141 |
|
| 142 |
- **Weights:** [Hugging Face](https://huggingface.co/PerceptronAI/Isaac-0.5)
|
|
|
|
| 76 |
|
| 77 |

|
| 78 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 79 |
## Performance benchmarks
|
| 80 |
|
| 81 |
We evaluate the same Isaac checkpoints across multimodal video understanding, spatial grounding, held-out action prediction, and closed-loop robot control.
|
|
|
|
| 84 |
|
| 85 |
*Up and to the left is better. Ringed Isaac 0.5 results sit on the frontier; hollow markers are dominated.*
|
| 86 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 87 |
## Where Isaac sits among open models
|
| 88 |
|
| 89 |
| Model | Robot training scope | Obs. steps | RTC-trained | Prev. actions | Mistake modeling | Non-robot video | Flow expert | Open source |
|
|
|
|
| 113 |
- checkpoint, data, and model-I/O manifests;
|
| 114 |
- the technical report, model card, and reproduction guide.
|
| 115 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 116 |
## Resources
|
| 117 |
|
| 118 |
- **Weights:** [Hugging Face](https://huggingface.co/PerceptronAI/Isaac-0.5)
|