File size: 2,967 Bytes
ae6447a 2e7c708 ae6447a 2e7c708 ae6447a 2e7c708 ae6447a 2e7c708 ae6447a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 | ---
license: mit
library_name: pytorch
tags:
- 3d-object-detection
- cooperative-perception
- autonomous-driving
- lidar
- camera
- v2x
---
# CooperScene: Multi-Modal Cooperative Autonomy Benchmark with C-V2X Communication Characterization
[](https://cisl.ucr.edu/CooperScene)
[](https://github.com/UCR-CISL/CooperScene)
[](https://huggingface.co/cisl-hf/CooperScene)
[](https://pytorch.org/get-started/locally/)
[](https://github.com/UCR-CISL/CooperScene/blob/main/LICENSE)
## Introduction
π This repository hosts the **model configs and pre-trained checkpoints** for
[CooperScene](https://cisl.ucr.edu/CooperScene) β the first real-world,
multi-agent, multi-modal cooperative autonomy dataset with C-V2X communication
characterization (three connected vehicles + one roadside unit, across
intersections, highway ramps, and parking areas).
π All training and inference code is open-sourced. See the
[project page](https://cisl.ucr.edu/CooperScene) and the
[GitHub repo](https://github.com/UCR-CISL/CooperScene) for details.
π¬ We welcome feedback and look forward to your comments!
## What's here
Each model has its config and matching checkpoint together under
`<model>/`:
| Cooperative detectors | BEVFusion |
|---|---|
| `cobevt` | `bevfusion_single_lidar` |
| `cosdh` | `bevfusion_single_lidarcam` |
| `ermvp` | `bevfusion_coop_lidar` |
| `v2vam` | `bevfusion_coop_lidarcam` |
| `v2vnet` | |
| `v2xvit` | |
All models run on a unified mmengine pipeline (`proj_first=True`, same global-sort
BEV/3D polygon-IoU AP @ 0.3 / 0.5 / 0.7), so the numbers are directly comparable.
## Download
```bash
pip install -U huggingface_hub
hf download cisl-hf/CooperScene --local-dir assets
# -> assets/<model>/{<model>.py, <model>.pth}
```
## Usage
Clone the [code repo](https://github.com/UCR-CISL/CooperScene), then evaluate or
train with a downloaded config + checkpoint:
```bash
# evaluate (test split by default)
python tools/test.py assets/ermvp/ermvp.py assets/ermvp/ermvp.pth
# train (warm-start from a checkpoint, optional)
python tools/train.py assets/ermvp/ermvp.py
```
See the [GitHub README](https://github.com/UCR-CISL/CooperScene) for data
preparation and the Docker workflow.
## Related links
π Website: [https://cisl.ucr.edu/CooperScene](https://cisl.ucr.edu/CooperScene)
π» GitHub: [https://github.com/UCR-CISL/CooperScene](https://github.com/UCR-CISL/CooperScene)
π€ Hugging Face: [https://huggingface.co/cisl-hf/CooperScene](https://huggingface.co/cisl-hf/CooperScene)
|