File size: 2,967 Bytes
ae6447a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2e7c708
ae6447a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2e7c708
ae6447a
 
 
 
 
 
 
 
 
2e7c708
ae6447a
 
2e7c708
ae6447a
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
---
license: mit
library_name: pytorch
tags:
- 3d-object-detection
- cooperative-perception
- autonomous-driving
- lidar
- camera
- v2x
---

# CooperScene: Multi-Modal Cooperative Autonomy Benchmark with C-V2X Communication Characterization

[![Website](https://img.shields.io/badge/Website-CooperScene-blue?style=for-the-badge)](https://cisl.ucr.edu/CooperScene)
[![Code](https://img.shields.io/badge/Code-CooperScene-181717.svg?style=for-the-badge&logo=github)](https://github.com/UCR-CISL/CooperScene)
[![HF Models](https://img.shields.io/badge/%F0%9F%A4%97-Models-yellow?style=for-the-badge)](https://huggingface.co/cisl-hf/CooperScene)
[![PyTorch](https://img.shields.io/badge/PyTorch-2.1.1-EE4C2C.svg?style=for-the-badge&logo=pytorch)](https://pytorch.org/get-started/locally/)
[![License](https://img.shields.io/badge/License-MIT-green.svg?style=for-the-badge)](https://github.com/UCR-CISL/CooperScene/blob/main/LICENSE)

## Introduction

πŸš— This repository hosts the **model configs and pre-trained checkpoints** for
[CooperScene](https://cisl.ucr.edu/CooperScene) β€” the first real-world,
multi-agent, multi-modal cooperative autonomy dataset with C-V2X communication
characterization (three connected vehicles + one roadside unit, across
intersections, highway ramps, and parking areas).

πŸš€ All training and inference code is open-sourced. See the
[project page](https://cisl.ucr.edu/CooperScene) and the
[GitHub repo](https://github.com/UCR-CISL/CooperScene) for details.

πŸ’¬ We welcome feedback and look forward to your comments!

## What's here

Each model has its config and matching checkpoint together under
`<model>/`:

| Cooperative detectors | BEVFusion |
|---|---|
| `cobevt` | `bevfusion_single_lidar` |
| `cosdh` | `bevfusion_single_lidarcam` |
| `ermvp` | `bevfusion_coop_lidar` |
| `v2vam` | `bevfusion_coop_lidarcam` |
| `v2vnet` | |
| `v2xvit` | |

All models run on a unified mmengine pipeline (`proj_first=True`, same global-sort
BEV/3D polygon-IoU AP @ 0.3 / 0.5 / 0.7), so the numbers are directly comparable.

## Download

```bash
pip install -U huggingface_hub
hf download cisl-hf/CooperScene --local-dir assets
# -> assets/<model>/{<model>.py, <model>.pth}
```

## Usage

Clone the [code repo](https://github.com/UCR-CISL/CooperScene), then evaluate or
train with a downloaded config + checkpoint:

```bash
# evaluate (test split by default)
python tools/test.py assets/ermvp/ermvp.py assets/ermvp/ermvp.pth

# train (warm-start from a checkpoint, optional)
python tools/train.py assets/ermvp/ermvp.py
```

See the [GitHub README](https://github.com/UCR-CISL/CooperScene) for data
preparation and the Docker workflow.

## Related links

🌐 Website: [https://cisl.ucr.edu/CooperScene](https://cisl.ucr.edu/CooperScene)

πŸ’» GitHub: [https://github.com/UCR-CISL/CooperScene](https://github.com/UCR-CISL/CooperScene)

πŸ€— Hugging Face: [https://huggingface.co/cisl-hf/CooperScene](https://huggingface.co/cisl-hf/CooperScene)