arthurdjn commited on
Commit
495c07e
·
verified ·
1 Parent(s): 6430477

Upload pointgpt-s.scanobjectnn-objonly.guangyan-chen

Browse files
Files changed (2) hide show
  1. README.md +107 -0
  2. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,107 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: torch-pointcloud
4
+ tags:
5
+ - point-cloud
6
+ - 3d
7
+ - pytorch
8
+ - torch-pointcloud
9
+ - pointgpt
10
+ - classification
11
+ datasets:
12
+ - scanobjectnn
13
+ base_model: torch-pointcloud/pointgpt-s.pretrain.guangyan-chen
14
+ model-index:
15
+ - name: pointgpt-s.scanobjectnn-objonly.guangyan-chen
16
+ results:
17
+ - task:
18
+ type: point-cloud-classification
19
+ dataset:
20
+ name: ScanObjectNN (OBJ_ONLY)
21
+ type: scanobjectnn
22
+ metrics:
23
+ - name: OA
24
+ type: accuracy
25
+ value: 90.71
26
+ ---
27
+
28
+ # Model card for pointgpt-s.scanobjectnn-objonly.guangyan-chen
29
+
30
+ A PointGPT point cloud classification model (autoregressive generative pretraining transformer). Trained on ScanObjectNN (OBJ_ONLY).
31
+
32
+ ## Model Details
33
+
34
+ - **Model Type:** Point cloud classification
35
+ - **Model Stats:**
36
+ - Params (M): 29.2
37
+ - Classes: 15
38
+ - Features: 768
39
+ - **Dataset:** ScanObjectNN (OBJ_ONLY)
40
+ - **Metrics:** OA 90.71 (reference 90.0)
41
+ - **Paper:** [PointGPT: Auto-regressively Generative Pre-training from Point Clouds](https://arxiv.org/abs/2305.11487)
42
+ - **Converted from:** [CGuangyan-BIT/PointGPT](https://github.com/CGuangyan-BIT/PointGPT) (MIT)
43
+ - **Library:** [torch-pointcloud](https://github.com/arthurdjn/pytorch-pointcloud)
44
+
45
+ ## Install
46
+
47
+ ```bash
48
+ pip install torch-pointcloud
49
+ ```
50
+
51
+ ## Usage
52
+
53
+ ```python
54
+ import torch
55
+ import torch_pointcloud as tp
56
+ from torch_pointcloud.utils.data import collate
57
+
58
+ model, info = tp.create_model(
59
+ "pointgpt-s.scanobjectnn-objonly.guangyan-chen",
60
+ task="classification",
61
+ pretrained=True,
62
+ return_info=True,
63
+ )
64
+ model = model.eval()
65
+
66
+ # synthetic sample with the keys a dataset provides
67
+ num_points = 8192
68
+ sample = {
69
+ "pos": torch.randn(num_points, 3),
70
+ }
71
+ data = info["transform"](sample)
72
+ data = collate([data])
73
+
74
+ with torch.no_grad():
75
+ logits = model(data.get("x"), data["pos"], data["batch"])
76
+ ```
77
+
78
+ ## Feature extraction
79
+
80
+ ```python
81
+ with torch.no_grad():
82
+ embeddings = model.forward_features(data.get("x"), data["pos"], data["batch"])
83
+
84
+ model.reset_classifier(num_classes=0)
85
+ with torch.no_grad():
86
+ embeddings = model(data.get("x"), data["pos"], data["batch"]) # (B, 768)
87
+ ```
88
+
89
+ ## Citation
90
+
91
+ ```bibtex
92
+ @inproceedings{chen2023pointgpt,
93
+ title = {PointGPT: Auto-regressively Generative Pre-training from Point Clouds},
94
+ author = {Guangyan Chen and Meiling Wang and Yi Yang and Kai Yu and Li Yuan and Yufeng Yue},
95
+ booktitle = {NeurIPS},
96
+ year = {2023}
97
+ }
98
+ ```
99
+
100
+ ```bibtex
101
+ @inproceedings{uy2019scanobjectnn,
102
+ title = {Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data},
103
+ author = {Mikaela Angelina Uy and Quang-Hieu Pham and Binh-Son Hua and Duc Thanh Nguyen and Sai-Kit Yeung},
104
+ booktitle = {ICCV},
105
+ year = {2019}
106
+ }
107
+ ```
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42c0fc5c952d9504976f1dc7f86d80e51670fd8ddb02514f05255331e4126db7
3
+ size 116815308