arthurdjn commited on
Commit
825fc9e
·
verified ·
1 Parent(s): ecbd244

Upload pointpillars-multihead.nuscenes.openpcdet

Browse files
Files changed (2) hide show
  1. README.md +97 -0
  2. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: torch-pointcloud
4
+ tags:
5
+ - point-cloud
6
+ - 3d
7
+ - pytorch
8
+ - torch-pointcloud
9
+ - pointpillars
10
+ - object-detection
11
+ datasets:
12
+ - nuscenes
13
+ ---
14
+
15
+ # Model card for pointpillars-multihead.nuscenes.openpcdet
16
+
17
+ A PointPillars 3D object detection model (pillar encoder with a 2D backbone). Trained on nuScenes.
18
+
19
+ ## Model Details
20
+
21
+ - **Model Type:** 3D object detection
22
+ - **Model Stats:**
23
+ - Params (M): 6.1
24
+ - Input channels: 5
25
+ - Classes: 10
26
+ - Features: 384
27
+ - **Dataset:** nuScenes
28
+ - **Paper:** [PointPillars: Fast Encoders for Object Detection from Point Clouds](https://arxiv.org/abs/1812.05784)
29
+ - **Converted from:** [open-mmlab/OpenPCDet](https://github.com/open-mmlab/OpenPCDet) (Apache-2.0)
30
+ - **Library:** [torch-pointcloud](https://github.com/arthurdjn/pytorch-pointcloud)
31
+
32
+ ## Install
33
+
34
+ ```bash
35
+ pip install torch-pointcloud
36
+ ```
37
+
38
+ ## Usage
39
+
40
+ ```python
41
+ import torch
42
+ import torch_pointcloud as tp
43
+ from torch_pointcloud.utils.data import collate
44
+
45
+ model, info = tp.create_model(
46
+ "pointpillars-multihead.nuscenes.openpcdet",
47
+ task="detection",
48
+ pretrained=True,
49
+ return_info=True,
50
+ )
51
+ model = model.eval()
52
+
53
+ # synthetic sample with the keys a dataset provides
54
+ num_points = 8192
55
+ sample = {
56
+ "pos": torch.randn(num_points, 3),
57
+ "intensity": torch.rand(num_points, 1),
58
+ "timestamp": torch.zeros(num_points, 1),
59
+ }
60
+ data = info["transform"](sample)
61
+ data = collate([data], batch_from="pos_voxel")
62
+
63
+ with torch.no_grad():
64
+ out = model(data["voxel"], data["pos_voxel"], data["voxel_num_points"], data["batch"])
65
+ ```
66
+
67
+ ## Feature extraction
68
+
69
+ ```python
70
+ with torch.no_grad():
71
+ features = model.forward_features(
72
+ data["voxel"],
73
+ data["pos_voxel"],
74
+ data["voxel_num_points"],
75
+ data["batch"],
76
+ ) # 384 channels
77
+ ```
78
+
79
+ ## Citation
80
+
81
+ ```bibtex
82
+ @inproceedings{lang2019pointpillars,
83
+ title = {PointPillars: Fast Encoders for Object Detection from Point Clouds},
84
+ author = {Alex H. Lang and Sourabh Vora and Holger Caesar and Lubing Zhou and Jiong Yang and Oscar Beijbom},
85
+ booktitle = {CVPR},
86
+ year = {2019}
87
+ }
88
+ ```
89
+
90
+ ```bibtex
91
+ @inproceedings{caesar2020nuscenes,
92
+ title = {nuScenes: A multimodal dataset for autonomous driving},
93
+ author = {Holger Caesar and Varun Bankiti and Alex H. Lang and Sourabh Vora and Venice Erin Liong and Qiang Xu and Anush Krishnan and Yu Pan and Giancarlo Baldan and Oscar Beijbom},
94
+ booktitle = {CVPR},
95
+ year = {2020}
96
+ }
97
+ ```
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01bf65c4bfca1fb00bc91522ad370a196665ea6a4c28e9437f308c504800275b
3
+ size 24404688