Uchihadj commited on
Commit
2c268d1
·
verified ·
1 Parent(s): f3b073e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +128 -1
README.md CHANGED
@@ -1,5 +1,132 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
3
  datasets:
4
  - gqk/opv2v
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ tags:
4
+ - autonomous-driving
5
+ - cooperative-perception
6
+ - bird-eye-view
7
+ - uncertainty-estimation
8
+ - hypernetwork
9
+ - segmentation
10
+ - opv2v
11
  datasets:
12
  - gqk/opv2v
13
+ ---
14
+
15
+ # Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird’s-Eye-View Semantic Segmentation
16
+
17
+ **IEEE Intelligent Vehicles Symposium (IV) 2026 – Oral Presentation**
18
+
19
+ [![Project Page](https://img.shields.io/badge/Project-Page-blue.svg)](https://abhishekjagtap1.github.io/HyperV2X/)  
20
+ [![arXiv](https://img.shields.io/badge/arXiv-Paper-red.svg)](https://arxiv.org/abs/2605.21309v1)  
21
+ [![GitHub Repo](https://img.shields.io/badge/GitHub-Code-FFD700?logo=github)](https://github.com/abhishekjagtap1/Hyper-V2X)  
22
+
23
+ This paper introduces Hyper-V2X, a hypernetwork-based framework for estimating both epistemic and aleatoric uncertainties in V2X-based perception.
24
+ Specifically, we propose
25
+ 1) Bayesian hypernetwork formulation for cooperative perception.
26
+ 2) V2X context embedding: that conditions a Bayesian hypernetwork on fused multi-agent features.
27
+ 3) Partial weight generation for Bayesian hypernetworks; that avoids generating the full set of model parameters, enabling efficient and scalable uncertainty estimation.
28
+
29
+ ## Overview
30
+
31
+ Hyper-V2X is a cooperative perception model for autonomous driving that performs **Bird’s-Eye-View (BEV) semantic segmentation** with **uncertainty estimation** under communication constraints.
32
+
33
+ It leverages a **Bayesian hypernetwork** conditioned on fused multi-agent BEV features to generate stochastic decoder weights, enabling:
34
+
35
+ - Epistemic uncertainty estimation (model uncertainty)
36
+ - Aleatoric uncertainty estimation (data uncertainty)
37
+ - Robust BEV semantic segmentation in V2X settings
38
+ - Performance under limited communication bandwidth / compression constraints
39
+
40
+
41
+ ## Training Data
42
+
43
+ Hyper-V2X is trained on:
44
+
45
+ - OPV2V cooperative perception dataset
46
+
47
+ Dataset reference:
48
+ - https://huggingface.co/datasets/gqk/opv2v
49
+
50
+
51
+
52
+ ## Quick Start
53
+
54
+ For full installation instructions please refer to the [Hyper-V2X GitHub repository](https://github.com/abhishekjagtap1/Hyper-V2X).
55
+
56
+ Once the dependencies are installed, you can use the load the checkpoints from Hugging Face.
57
+
58
+
59
+ ```python
60
+ from torch.utils.data import DataLoader
61
+ import opencood.hypes_yaml.yaml_utils as yaml_utils
62
+ from opencood.tools import train_utils
63
+ from opencood.data_utils.datasets import build_dataset
64
+ from opencood.utils.seg_utils import (
65
+ cal_iou_training,
66
+ cal_ece_brier_score,
67
+ cal_nll_brier_score
68
+ )
69
+
70
+ dataset = build_dataset(hypes, visualize=False, train=False)
71
+
72
+ loader = DataLoader(
73
+ dataset,
74
+ batch_size=1,
75
+ shuffle=False,
76
+ num_workers=args.num_workers,
77
+ collate_fn=dataset.collate_batch,
78
+ pin_memory=False,
79
+ drop_last=False
80
+ )
81
+
82
+ print("Loading model...")
83
+ model = train_utils.create_model(hypes)
84
+
85
+ device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
86
+ model.to(device)
87
+ print(model)
88
+
89
+ _, model = train_utils.load_saved_model(args.model_dir, model)
90
+ model.eval()
91
+
92
+ # ---------------- RICH PROGRESS ----------------
93
+ with torch.no_grad():
94
+ with Live(refresh_per_second=4, console=console) as live:
95
+ with Progress(
96
+ TextColumn("Inference"),
97
+ BarColumn(),
98
+ TextColumn("{task.completed}/{task.total}"),
99
+ TimeElapsedColumn(),
100
+ TimeRemainingColumn(),
101
+ ) as progress:
102
+
103
+ task = progress.add_task("run", total=total)
104
+
105
+ for i, batch_data in enumerate(loader):
106
+
107
+ batch_data = train_utils.to_device(batch_data, device)
108
+
109
+ model_out = model(batch_data['ego'])
110
+ post_output = dataset.post_process(batch_data['ego'], model_out)
111
+
112
+ # Segmentation Metric
113
+ iou_d, iou_s = cal_iou_training(batch_data, post_output)
114
+
115
+ ##### Uncertainty Metrics #########
116
+ ece, ece_eqp, _ = cal_ece_brier_score(batch_data, post_output)
117
+ nll, brier = cal_nll_brier_score(batch_data, post_output)
118
+
119
+
120
+ ```
121
+
122
+ ## Citation
123
+
124
+ ```bibtex
125
+ @article{jagtap2026hyper,
126
+ title={Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird's-Eye-View Semantic Segmentation},
127
+ author={Jagtap, Abhishek Dinkar and Sadashivaiah, Sanath Tiptur and Festag, Andreas},
128
+ journal={arXiv preprint arXiv:2605.21309},
129
+ year={2026}
130
+ }
131
+ ```
132
+