AF-HuggingFace commited on
Commit
eb9968a
Β·
verified Β·
1 Parent(s): 98a92a5

Upload 3 files

Browse files
Files changed (3) hide show
  1. README.md +72 -9
  2. app.py +0 -0
  3. requirements.txt +9 -0
README.md CHANGED
@@ -1,14 +1,77 @@
1
  ---
2
- title: AEGIS Reason
3
- emoji: 🐨
4
- colorFrom: gray
5
- colorTo: yellow
6
  sdk: gradio
7
- sdk_version: 6.8.0
 
8
  app_file: app.py
9
- pinned: false
10
- license: mit
11
- short_description: The Whole Operating System
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: "AEGIS-Reason: Post-Training Cosmos Reason 2 for Healthcare Physical AI"
3
+ emoji: πŸ›‘οΈ
4
+ colorFrom: green
5
+ colorTo: blue
6
  sdk: gradio
7
+ sdk_version: "4.44.1"
8
+ python_version: "3.12"
9
  app_file: app.py
10
+ pinned: true
11
+ license: apache-2.0
12
+ tags:
13
+ - nvidia
14
+ - cosmos
15
+ - physical-ai
16
+ - healthcare
17
+ - robotics
18
+ - cosmos-cookoff
19
+ - isaac-sim
20
+ - gradio
21
+ short_description: "Cosmos Reason 2 healthcare Physical AI β€” 3D arena"
22
  ---
23
 
24
+ # πŸ›‘οΈ AEGIS-Reason: Post-Training Cosmos Reason 2 for Vision-Grounded Multi-Robot Healthcare Coordination
25
+
26
+ **NVIDIA Cosmos Cookoff 2026 β€” Competition Submission**
27
+
28
+ The first-ever application of Cosmos Reason 2 to healthcare Physical AI β€” a fully interactive, physics-grounded 3D hospital arena with live VLM inference, uncertainty-quantified multi-robot coordination, and a 119-entry medical knowledge base across 4 embodied robot classes and 12 clinical domains.
29
+
30
+ ## πŸ—οΈ Isaac Lab 3D Arena β€” Main Showcase
31
+
32
+ The centerpiece is a **449,580-character self-contained 3D simulation** (zero external dependencies) orchestrating 4 classes of healthcare robots inside a unified hospital floor plan:
33
+
34
+ | Robot | Physics Model | Key Metric (seed=42) |
35
+ |-------|--------------|---------------------|
36
+ | 🦾 Surgical Arms (da Vinci Xi) | 7-DOF kinematics, Jacobian IK, Kelvin-Voigt tissue | 1.9Γ— speed, 90% tremor reduction |
37
+ | πŸ₯ Hospital AMR Fleet | DWA, SLAM + A*, collision avoidance | 1.3Γ— throughput, collisions 2 β†’ 0 |
38
+ | 🚁 Medical Drones | 3D BΓ©zier flight, wind-coupled dynamics | 73% on-time, energy βˆ’16% |
39
+ | 🦿 Rehab Exoskeleton | Inverted-pendulum gait, biomechanical torque | Falls 28 β†’ 9, 6MWT 152 β†’ 208 m |
40
+
41
+ Every slider change re-simulates all 4 robot subsystems and updates entity counts, physics trajectories, narration text, and CR2 inference chains in real time.
42
+
43
+ ## ⚑ Cosmos Reason 2 Integration
44
+
45
+ CR2 (8B, Qwen3-VL, 256K context) serves as the decision-making backbone in three integration patterns: live VLM inference with 5-axis reasoning chains, LoRA post-training (r=16, Ξ±=32, 22 hospital SFT examples), and critic/reward role in the Cosmos closed-loop flywheel.
46
+
47
+ ## πŸ“Š Architecture
48
+
49
+ 10,989 lines of research-grade Python across 7 modules (A–G), producing 112 functions, 24 interactive Gradio tabs, 14 interactive 3D plots, and 22 event-driven callbacks. The full NVIDIA Physical AI stack: Cosmos WFMs, Isaac Sim 6.0, PhysX 5.6.1, Dynamo, NIM v1.6.0, Jetson AGX Thor (2,070 FP4 TFLOPS), Earth-2, and CRAG retrieval.
50
+
51
+ ## πŸš€ Running Locally
52
+
53
+ ```bash
54
+ git clone https://huggingface.co/spaces/YOUR_USERNAME/AEGIS-Reason
55
+ cd AEGIS-Reason
56
+ pip install -r requirements.txt
57
+ python app.py
58
+ ```
59
+
60
+ Optional (for live CR2 inference β€” requires GPU with β‰₯8 GB VRAM):
61
+ ```bash
62
+ pip install torch transformers accelerate peft
63
+ ```
64
+
65
+ Without a GPU, the application runs in cached/simulated mode with full interactivity across all 24 tabs.
66
+
67
+ ## πŸ“‹ Files
68
+
69
+ | File | Description |
70
+ |------|-------------|
71
+ | `app.py` | Main application (12,825 lines) |
72
+ | `requirements.txt` | Python dependencies |
73
+ | `README.md` | This file (HF Spaces metadata) |
74
+
75
+ ## πŸ† Cosmos Cookoff 2026
76
+
77
+ Built for the NVIDIA Cosmos Cookoff 2026. Judging criteria: Quality of Ideas, Technical Implementation, Design, and Impact. Judges from Datature, Hugging Face, Nebius, Nexar, and NVIDIA.
app.py ADDED
The diff for this file is too large to render. See raw diff
 
requirements.txt ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ gradio==4.44.1
2
+ huggingface_hub<1.0
3
+ pydantic<2.11
4
+ numpy>=1.24.0
5
+ scipy>=1.10.0
6
+ matplotlib>=3.7.0
7
+ Pillow>=9.4.0
8
+ plotly>=5.14.0,<6
9
+ trimesh>=3.21.0