| ---
|
| license: cc-by-4.0
|
| library_name: pytorch
|
| tags:
|
| - digital-twins
|
| - scene-graphs
|
| - dynamic-scene-graphs
|
| - robotics
|
| - support-relations
|
| - graph-maintenance
|
| - counterfactual-evidence
|
| - pytorch
|
| ---
|
|
|
| # CF-SupportNet
|
|
|
| CF-SupportNet is the learned edge-scoring component of **MedPhyGraph** (ECCV 2026 TwinWorld Workshop). It is **not** the full MedPhyGraph framework by itself: MedPhyGraph additionally applies deterministic State Consistency and Union-Based Transition-Aware Consistency β non-learned, code-only operations β on top of these scores to produce the final maintained support graph. See the [project page](https://medphygraph.github.io/) for the paper and complete pipeline code.
|
|
|
| ## Files
|
|
|
| | File | Role |
|
| |---|---|
|
| | `health_dyphygraph_r1.0_seed0.pt` | Primary checkpoint β used for all headline results in the paper (Ο=1.0, seed 0) |
|
| | `health_dyphygraph_r1.0_seed{1-4}.pt` | Used only for the paper's multi-seed reproducibility audit; not intended as alternative production checkpoints |
|
|
|
| ## Architecture
|
|
|
| - One-layer GRU, hidden width 64 (temporal encoder over counterfactual evidence channels)
|
| - Geometry branch: 2 β 32 β 32 MLP (static geometric channels)
|
| - Fusion branch: 96 β 64 β 64 MLP, dropout 0.1
|
| - **25,409 trainable parameters** total
|
|
|
| Full architectural and training details are in the paper, Section 3.4.
|
|
|
| ## Results
|
|
|
| Frozen seed-0 checkpoint, full observation (Ο=1.0):
|
|
|
| | Protocol | Transition-Macro Dyn-F1 | Pooled Delta Micro-F1 | Transfer Dyn-F1 |
|
| |---|---|---|---|
|
| | Core (15 transfers, Isaac + Procedural) | 1.000 | 1.000 | 1.000 |
|
| | Expanded (217 transfers, 19 templates) | β | β | 0.998 |
|
|
|
| Across seeds 0β4, pooled Transfer Dyn-F1 on the expanded suite is 0.997 Β± 0.001.
|
|
|
| ## Loading the checkpoint
|
|
|
| ```python
|
| from huggingface_hub import hf_hub_download
|
| import torch
|
|
|
| path = hf_hub_download(
|
| repo_id="MedPhyGraph/CF-SupportNet",
|
| filename="health_dyphygraph_r1.0_seed0.pt",
|
| )
|
| state_dict = torch.load(path, map_location="cpu", weights_only=True)
|
| ```
|
|
|
| > This repository hosts raw PyTorch weights only, not a packaged `from_pretrained`-compatible class. To reconstruct the model, define the architecture above (or import it from the [code repository](https://medphygraph.github.io/)) and load `state_dict` into it directly.
|
|
|
| ## Limitations
|
|
|
| - The counterfactual evidence used at both training and inference comes from an analytic AABB-based host-removal proxy, not a full physics simulator β it does not model mesh collisions, contact forces, or materials.
|
| - Operates downstream of perception on structured object states (poses, categories, AABB extents); it does not take raw RGB-D or perception input.
|
| - Evaluates direct, primary `SupportedBy` relations only.
|
| - Assumes the correct destination candidate is present in the candidate set at inference; if it is not, a support transfer cannot be recovered by the scorer or the downstream graph-maintenance stages.
|
| - Does not model distributed support, articulated contact, or temporary/transient support.
|
|
|
| ## Related artifacts
|
|
|
| - Structured training/evaluation data (procedural + Isaac for Healthcare-derived scenes): `MedPhyGraph/support-graph-data` *(forthcoming)*
|
|
|
| ## Citation
|
|
|
| ```bibtex
|
| @inproceedings{gholizadeh2026medphygraph,
|
| title = {MedPhyGraph: Counterfactual Support-Graph Maintenance for Dynamic Built-Environment Digital Twins},
|
| author = {Gholizadeh HamlAbadi, Kamran and Vahdati, Monica and El Saddik, Abdulmotaleb},
|
| booktitle = {ECCV 2026 Workshop on Visual Intelligence for Built Environment Digital Twins (TwinWorld)},
|
| year = {2026}
|
| }
|
| ``` |