arthurdjn commited on
Commit
6cfbf60
·
verified ·
1 Parent(s): 5b605f7

Upload point-bert-base.modelnet40.xumin-yu

Browse files
Files changed (2) hide show
  1. README.md +108 -0
  2. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,108 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: torch-pointcloud
4
+ tags:
5
+ - point-cloud
6
+ - 3d
7
+ - pytorch
8
+ - torch-pointcloud
9
+ - point-bert
10
+ - classification
11
+ datasets:
12
+ - modelnet40
13
+ base_model: torch-pointcloud/point-bert-base.pretrain.xumin-yu
14
+ model-index:
15
+ - name: point-bert-base.modelnet40.xumin-yu
16
+ results:
17
+ - task:
18
+ type: point-cloud-classification
19
+ dataset:
20
+ name: ModelNet40
21
+ type: modelnet40
22
+ metrics:
23
+ - name: OA
24
+ type: accuracy
25
+ value: 92.63
26
+ ---
27
+
28
+ # Model card for point-bert-base.modelnet40.xumin-yu
29
+
30
+ A Point-BERT point cloud classification model (masked point modeling transformer). Trained on ModelNet40.
31
+
32
+ ## Model Details
33
+
34
+ - **Model Type:** Point cloud classification
35
+ - **Model Stats:**
36
+ - Params (M): 22.1
37
+ - Classes: 40
38
+ - Features: 768
39
+ - **Dataset:** ModelNet40
40
+ - **Metrics:** OA 92.63 (reference 92.67)
41
+ - **Paper:** [Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling](https://arxiv.org/abs/2111.14819)
42
+ - **Converted from:** [Julie-tang00/Point-BERT](https://github.com/Julie-tang00/Point-BERT) (MIT)
43
+ - **Library:** [torch-pointcloud](https://github.com/arthurdjn/pytorch-pointcloud)
44
+
45
+ ## Install
46
+
47
+ ```bash
48
+ pip install torch-pointcloud
49
+ ```
50
+
51
+ ## Usage
52
+
53
+ ```python
54
+ import torch
55
+ import torch_pointcloud as tp
56
+ from torch_pointcloud.utils.data import collate
57
+
58
+ model, info = tp.create_model(
59
+ "point-bert-base.modelnet40.xumin-yu",
60
+ task="classification",
61
+ pretrained=True,
62
+ return_info=True,
63
+ )
64
+ model = model.eval()
65
+
66
+ # synthetic sample with the keys a dataset provides
67
+ num_points = 8192
68
+ sample = {
69
+ "pos": torch.randn(num_points, 3),
70
+ "normal": torch.randn(num_points, 3),
71
+ }
72
+ data = info["transform"](sample)
73
+ data = collate([data])
74
+
75
+ with torch.no_grad():
76
+ logits = model(data.get("x"), data["pos"], data["batch"])
77
+ ```
78
+
79
+ ## Feature extraction
80
+
81
+ ```python
82
+ with torch.no_grad():
83
+ embeddings = model.forward_features(data.get("x"), data["pos"], data["batch"])
84
+
85
+ model.reset_classifier(num_classes=0)
86
+ with torch.no_grad():
87
+ embeddings = model(data.get("x"), data["pos"], data["batch"]) # (B, 768)
88
+ ```
89
+
90
+ ## Citation
91
+
92
+ ```bibtex
93
+ @inproceedings{yu2022pointbert,
94
+ title = {Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling},
95
+ author = {Xumin Yu and Lulu Tang and Yongming Rao and Tiejun Huang and Jie Zhou and Jiwen Lu},
96
+ booktitle = {CVPR},
97
+ year = {2022}
98
+ }
99
+ ```
100
+
101
+ ```bibtex
102
+ @inproceedings{wu2015modelnet,
103
+ title = {3D ShapeNets: A Deep Representation for Volumetric Shapes},
104
+ author = {Zhirong Wu and Shuran Song and Aditya Khosla and Fisher Yu and Linguang Zhang and Xiaoou Tang and Jianxiong Xiao},
105
+ booktitle = {CVPR},
106
+ year = {2015}
107
+ }
108
+ ```
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d91c761adcf53cf67d6916d83e39577cc5711944e32de320cd00673db4595c60
3
+ size 88285608