Instructions to use NeoteAI/n0-twam-univtac-delta with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use NeoteAI/n0-twam-univtac-delta with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("NeoteAI/n0-twam-univtac-delta", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
N0-TWAM post-training β UniVTAC 8 single-arm tasks / pi05_delta (horizon delta)
Multi-task post-trained N0-TWAM checkpoint (final release). Trained on marker-less rgb GelSight tactile streams; each task uses its own normalization statistics.
Serving note. Multi-task checkpoints must be served with the per-task
norm / camera+tactile keys / action channels of the task being evaluated β the
pooled envelope in train_meta.json is an unreachable fallback and would
de-normalize actions at the wrong scale. Use the multitask_server config
(TWAM_SERVE_POOL / TWAM_SERVE_TASK env β see
DEPLOY.md);
prompts verbatim from the table below.
Contents: transformer/ (config.json + safetensors, local_tactile tensors = 18),
train_meta.json (training snapshot), and norm/ (per-task normalization stats +
conversion scripts).
Per-task normalization stats
The exact per-task q01/q99 tables used in training are released under
norm/, together with the raw-quantile reports and the
HDF5 β LeRobot conversion scripts. The element-wise envelope of these tables
reproduces the pool-level norm_stat in train_meta.json bit-exactly.
Task prompts
Send the training prompt verbatim at serve/eval time (also provided as
norm/PROMPTS.json):
| Task | Prompt |
|---|---|
insert_tube |
Insert a tube into a tilted fixture |
insert_hole |
Precision peg-in-hole insertion |
insert_HDMI |
Insert an HDMI connector into a port |
grasp_classify |
Grasp an object and classify it by tactile texture |
pull_out_key |
Untwist and extract a key from a lock |
lift_can |
Rotate a lying can so it stands upright |
lift_bottle |
Grasp and lift a bottle off a surface near a wall |
put_bottle_in_shelf |
Reorient a bottle upright and place it on a shelf |
- Downloads last month
- -