README.md

metadata

title: MolmoAct2 SO100 101 Inference
emoji: 🤖
colorFrom: indigo
colorTo: blue
sdk: docker
app_port: 7860
pinned: false
short_description: Nori cloud-inference server for MolmoAct2-SO100_101 (/act)

MolmoAct2-SO100_101 — Nori cloud inference

Private Docker Space serving allenai/MolmoAct2-SO100_101 for Nori robot rollout. It runs our own FastAPI/uvicorn server (molmoact2_server.py) — not the HF Inference-Endpoint toolkit, which is incompatible with the transformers version this model needs.

Endpoints

• GET /health → {"ok", "status": "loading|ready|error", "error", "repo", "dtype"}
• POST /act (Bearer NORI_INFER_TOKEN) → { images:[b64...], state:[6 floats], instruction:str, num_steps? } → { actions: [[...6 DOF...], ... up to 30 moves] } (robot scale).

Required setup (Space Settings)

1. Hardware: a GPU tier — a10g-small (A10G 24GB, ~$1/hr) is enough (bf16 <16GB).
2. Secrets:
   • NORI_INFER_TOKEN — the bearer token the rollout client sends (required).
   • HF_TOKEN — only if the model repo is gated (allenai's is public; usually not needed).
3. First boot downloads ~21GB, so /health reports "loading" for a few minutes, then "ready". Add persistent storage later to skip re-downloads on restart.

Deploy/update instructions: see cloud_inference/space/DEPLOY.md in the Nori-Lab repo.