arthurdjn commited on
Commit
0252c1c
·
verified ·
1 Parent(s): f537098

Upload second.kitti.openpcdet

Browse files
Files changed (2) hide show
  1. README.md +113 -0
  2. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: torch-pointcloud
4
+ tags:
5
+ - point-cloud
6
+ - 3d
7
+ - pytorch
8
+ - torch-pointcloud
9
+ - second
10
+ - object-detection
11
+ datasets:
12
+ - kitti
13
+ model-index:
14
+ - name: second.kitti.openpcdet
15
+ results:
16
+ - task:
17
+ type: 3d-object-detection
18
+ dataset:
19
+ name: KITTI
20
+ type: kitti
21
+ metrics:
22
+ - name: mAP
23
+ type: map
24
+ value: 66.11
25
+ ---
26
+
27
+ # Model card for second.kitti.openpcdet
28
+
29
+ A SECOND 3D object detection model (sparse convolutional voxel detector). Trained on KITTI.
30
+
31
+ ## Model Details
32
+
33
+ - **Model Type:** 3D object detection
34
+ - **Model Stats:**
35
+ - Params (M): 5.3
36
+ - Input channels: 4
37
+ - Classes: 3
38
+ - Features: 512
39
+ - **Dataset:** KITTI
40
+ - **Metrics:** mAP 66.11 (reference 66.25)
41
+ - **Paper:** [SECOND: Sparsely Embedded Convolutional Detection](https://www.mdpi.com/1424-8220/18/10/3337)
42
+ - **Converted from:** [open-mmlab/OpenPCDet](https://github.com/open-mmlab/OpenPCDet) (Apache-2.0)
43
+ - **Library:** [torch-pointcloud](https://github.com/arthurdjn/pytorch-pointcloud)
44
+
45
+ ## Install
46
+
47
+ ```bash
48
+ pip install torch-pointcloud
49
+ ```
50
+
51
+ ## Usage
52
+
53
+ ```python
54
+ import torch
55
+ import torch_pointcloud as tp
56
+ from torch_pointcloud.utils.data import collate
57
+
58
+ model, info = tp.create_model(
59
+ "second.kitti.openpcdet",
60
+ task="detection",
61
+ pretrained=True,
62
+ return_info=True,
63
+ )
64
+ model = model.cuda().eval() # GPU-only kernels
65
+
66
+ # synthetic sample with the keys a dataset provides
67
+ num_points = 8192
68
+ sample = {
69
+ "pos": torch.randn(num_points, 3),
70
+ "intensity": torch.rand(num_points, 1),
71
+ }
72
+ data = info["transform"](sample)
73
+ data = collate([data], batch_from="pos_voxel")
74
+ data = {key: value.cuda() for key, value in data.items()}
75
+
76
+ with torch.no_grad():
77
+ out = model(data["voxel"], data["pos_voxel"], data["voxel_num_points"], data["batch"])
78
+ ```
79
+
80
+ ## Feature extraction
81
+
82
+ ```python
83
+ with torch.no_grad():
84
+ features = model.forward_features(
85
+ data["voxel"],
86
+ data["pos_voxel"],
87
+ data["voxel_num_points"],
88
+ data["batch"],
89
+ ) # 512 channels
90
+ ```
91
+
92
+ ## Citation
93
+
94
+ ```bibtex
95
+ @article{yan2018second,
96
+ title = {{SECOND}: Sparsely Embedded Convolutional Detection},
97
+ author = {Yan, Yan and Mao, Yuxing and Li, Bo},
98
+ journal = {Sensors},
99
+ volume = {18},
100
+ number = {10},
101
+ pages = {3337},
102
+ year = {2018}
103
+ }
104
+ ```
105
+
106
+ ```bibtex
107
+ @inproceedings{geiger2012kitti,
108
+ title = {Are we ready for Autonomous Driving? The {KITTI} Vision Benchmark Suite},
109
+ author = {Geiger, Andreas and Lenz, Philip and Urtasun, Raquel},
110
+ booktitle = {CVPR},
111
+ year = {2012}
112
+ }
113
+ ```
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca4e1b68458fcbd914529c920ff61a7240a7c723b9e7900bd81691de607eae77
3
+ size 21346712