arthurdjn commited on
Commit
460d511
·
verified ·
1 Parent(s): 311dfd0

Upload concerto-large.pretrain.pointcept

Browse files
Files changed (2) hide show
  1. README.md +76 -0
  2. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ library_name: torch-pointcloud
4
+ tags:
5
+ - point-cloud
6
+ - 3d
7
+ - pytorch
8
+ - torch-pointcloud
9
+ - concerto
10
+ - self-supervised
11
+ ---
12
+
13
+ # Model card for concerto-large.pretrain.pointcept
14
+
15
+ A Concerto self-supervised pretraining model (joint 2D-3D representation encoder).
16
+
17
+ > **Non-commercial.** These weights are released by [Pointcept/Concerto](https://github.com/Pointcept/Concerto) under CC BY-NC 4.0 and may be used for research and evaluation only.
18
+
19
+ ## Model Details
20
+
21
+ - **Model Type:** Self-supervised pretraining
22
+ - **Model Stats:**
23
+ - Params (M): 207.7
24
+ - Input channels: 9
25
+ - **Paper:** [Concerto: Joint 2D-3D Self-Supervised Learning Emerges Spatial Representations](https://arxiv.org/abs/2510.23607)
26
+ - **Converted from:** [Pointcept/Concerto](https://github.com/Pointcept/Concerto) (CC-BY-NC-4.0)
27
+ - **Library:** [torch-pointcloud](https://github.com/arthurdjn/pytorch-pointcloud)
28
+
29
+ ## Install
30
+
31
+ ```bash
32
+ pip install torch-pointcloud
33
+ ```
34
+
35
+ ## Usage
36
+
37
+ ```python
38
+ import torch
39
+ import torch_pointcloud as tp
40
+ from torch_pointcloud.utils.data import collate
41
+
42
+ model, info = tp.create_model(
43
+ "concerto-large.pretrain.pointcept",
44
+ task="base",
45
+ pretrained=True,
46
+ return_info=True,
47
+ )
48
+ model = model.cuda().eval() # GPU-only kernels
49
+
50
+ # synthetic sample with the keys a dataset provides
51
+ num_points = 8192
52
+ sample = {
53
+ "pos": torch.randn(num_points, 3),
54
+ "color": torch.rand(num_points, 3) * 255,
55
+ "normal": torch.randn(num_points, 3),
56
+ "segment": torch.zeros(num_points, dtype=torch.long),
57
+ "instance": torch.zeros(num_points, dtype=torch.long),
58
+ }
59
+ data = info["transform"](sample)
60
+ data = collate([data])
61
+ data = {key: value.cuda() for key, value in data.items()}
62
+
63
+ with torch.no_grad():
64
+ out = model(data.get("x"), data["pos_grid"], data["batch"], pos=data["pos"])
65
+ ```
66
+
67
+ ## Citation
68
+
69
+ ```bibtex
70
+ @article{concerto2025,
71
+ title = {Concerto: Joint 2D-3D Self-Supervised Learning Emerges Spatial Representations},
72
+ author = {Yujia Zhang and Xiaoyang Wu and Yixing Lao and Chengyao Wang and Zhuotao Tian and Naiyan Wang and Hengshuang Zhao},
73
+ journal = {arXiv preprint arXiv:2510.23607},
74
+ year = {2025}
75
+ }
76
+ ```
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8e6352f80bcf93b00bd2fe86ba4999e9201094c74ad565d9dd702c001a826bf
3
+ size 830715200