Spaces:
Running
Running
Upload 3 files
Browse files- README.md +72 -9
- app.py +0 -0
- requirements.txt +9 -0
README.md
CHANGED
|
@@ -1,14 +1,77 @@
|
|
| 1 |
---
|
| 2 |
-
title: AEGIS Reason
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: gradio
|
| 7 |
-
sdk_version:
|
|
|
|
| 8 |
app_file: app.py
|
| 9 |
-
pinned:
|
| 10 |
-
license:
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: "AEGIS-Reason: Post-Training Cosmos Reason 2 for Healthcare Physical AI"
|
| 3 |
+
emoji: π‘οΈ
|
| 4 |
+
colorFrom: green
|
| 5 |
+
colorTo: blue
|
| 6 |
sdk: gradio
|
| 7 |
+
sdk_version: "4.44.1"
|
| 8 |
+
python_version: "3.12"
|
| 9 |
app_file: app.py
|
| 10 |
+
pinned: true
|
| 11 |
+
license: apache-2.0
|
| 12 |
+
tags:
|
| 13 |
+
- nvidia
|
| 14 |
+
- cosmos
|
| 15 |
+
- physical-ai
|
| 16 |
+
- healthcare
|
| 17 |
+
- robotics
|
| 18 |
+
- cosmos-cookoff
|
| 19 |
+
- isaac-sim
|
| 20 |
+
- gradio
|
| 21 |
+
short_description: "Cosmos Reason 2 healthcare Physical AI β 3D arena"
|
| 22 |
---
|
| 23 |
|
| 24 |
+
# π‘οΈ AEGIS-Reason: Post-Training Cosmos Reason 2 for Vision-Grounded Multi-Robot Healthcare Coordination
|
| 25 |
+
|
| 26 |
+
**NVIDIA Cosmos Cookoff 2026 β Competition Submission**
|
| 27 |
+
|
| 28 |
+
The first-ever application of Cosmos Reason 2 to healthcare Physical AI β a fully interactive, physics-grounded 3D hospital arena with live VLM inference, uncertainty-quantified multi-robot coordination, and a 119-entry medical knowledge base across 4 embodied robot classes and 12 clinical domains.
|
| 29 |
+
|
| 30 |
+
## ποΈ Isaac Lab 3D Arena β Main Showcase
|
| 31 |
+
|
| 32 |
+
The centerpiece is a **449,580-character self-contained 3D simulation** (zero external dependencies) orchestrating 4 classes of healthcare robots inside a unified hospital floor plan:
|
| 33 |
+
|
| 34 |
+
| Robot | Physics Model | Key Metric (seed=42) |
|
| 35 |
+
|-------|--------------|---------------------|
|
| 36 |
+
| π¦Ύ Surgical Arms (da Vinci Xi) | 7-DOF kinematics, Jacobian IK, Kelvin-Voigt tissue | 1.9Γ speed, 90% tremor reduction |
|
| 37 |
+
| π₯ Hospital AMR Fleet | DWA, SLAM + A*, collision avoidance | 1.3Γ throughput, collisions 2 β 0 |
|
| 38 |
+
| π Medical Drones | 3D BΓ©zier flight, wind-coupled dynamics | 73% on-time, energy β16% |
|
| 39 |
+
| π¦Ώ Rehab Exoskeleton | Inverted-pendulum gait, biomechanical torque | Falls 28 β 9, 6MWT 152 β 208 m |
|
| 40 |
+
|
| 41 |
+
Every slider change re-simulates all 4 robot subsystems and updates entity counts, physics trajectories, narration text, and CR2 inference chains in real time.
|
| 42 |
+
|
| 43 |
+
## β‘ Cosmos Reason 2 Integration
|
| 44 |
+
|
| 45 |
+
CR2 (8B, Qwen3-VL, 256K context) serves as the decision-making backbone in three integration patterns: live VLM inference with 5-axis reasoning chains, LoRA post-training (r=16, Ξ±=32, 22 hospital SFT examples), and critic/reward role in the Cosmos closed-loop flywheel.
|
| 46 |
+
|
| 47 |
+
## π Architecture
|
| 48 |
+
|
| 49 |
+
10,989 lines of research-grade Python across 7 modules (AβG), producing 112 functions, 24 interactive Gradio tabs, 14 interactive 3D plots, and 22 event-driven callbacks. The full NVIDIA Physical AI stack: Cosmos WFMs, Isaac Sim 6.0, PhysX 5.6.1, Dynamo, NIM v1.6.0, Jetson AGX Thor (2,070 FP4 TFLOPS), Earth-2, and CRAG retrieval.
|
| 50 |
+
|
| 51 |
+
## π Running Locally
|
| 52 |
+
|
| 53 |
+
```bash
|
| 54 |
+
git clone https://huggingface.co/spaces/YOUR_USERNAME/AEGIS-Reason
|
| 55 |
+
cd AEGIS-Reason
|
| 56 |
+
pip install -r requirements.txt
|
| 57 |
+
python app.py
|
| 58 |
+
```
|
| 59 |
+
|
| 60 |
+
Optional (for live CR2 inference β requires GPU with β₯8 GB VRAM):
|
| 61 |
+
```bash
|
| 62 |
+
pip install torch transformers accelerate peft
|
| 63 |
+
```
|
| 64 |
+
|
| 65 |
+
Without a GPU, the application runs in cached/simulated mode with full interactivity across all 24 tabs.
|
| 66 |
+
|
| 67 |
+
## π Files
|
| 68 |
+
|
| 69 |
+
| File | Description |
|
| 70 |
+
|------|-------------|
|
| 71 |
+
| `app.py` | Main application (12,825 lines) |
|
| 72 |
+
| `requirements.txt` | Python dependencies |
|
| 73 |
+
| `README.md` | This file (HF Spaces metadata) |
|
| 74 |
+
|
| 75 |
+
## π Cosmos Cookoff 2026
|
| 76 |
+
|
| 77 |
+
Built for the NVIDIA Cosmos Cookoff 2026. Judging criteria: Quality of Ideas, Technical Implementation, Design, and Impact. Judges from Datature, Hugging Face, Nebius, Nexar, and NVIDIA.
|
app.py
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
requirements.txt
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
gradio==4.44.1
|
| 2 |
+
huggingface_hub<1.0
|
| 3 |
+
pydantic<2.11
|
| 4 |
+
numpy>=1.24.0
|
| 5 |
+
scipy>=1.10.0
|
| 6 |
+
matplotlib>=3.7.0
|
| 7 |
+
Pillow>=9.4.0
|
| 8 |
+
plotly>=5.14.0,<6
|
| 9 |
+
trimesh>=3.21.0
|