arthurdjn commited on
Commit
d0a7dcd
·
verified ·
1 Parent(s): 86a589f

Upload sonata-base.pretrain.fair

Browse files
Files changed (2) hide show
  1. README.md +76 -0
  2. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ library_name: torch-pointcloud
4
+ tags:
5
+ - point-cloud
6
+ - 3d
7
+ - pytorch
8
+ - torch-pointcloud
9
+ - sonata
10
+ - self-supervised
11
+ ---
12
+
13
+ # Model card for sonata-base.pretrain.fair
14
+
15
+ A Sonata self-supervised pretraining model (self-distilled point representation encoder).
16
+
17
+ > **Non-commercial.** These weights are released by [facebookresearch/sonata](https://github.com/facebookresearch/sonata) under CC BY-NC 4.0 and may be used for research and evaluation only.
18
+
19
+ ## Model Details
20
+
21
+ - **Model Type:** Self-supervised pretraining
22
+ - **Model Stats:**
23
+ - Params (M): 108.5
24
+ - Input channels: 9
25
+ - **Paper:** [Sonata: Self-Supervised Learning of Reliable Point Representations](https://arxiv.org/abs/2503.16429)
26
+ - **Converted from:** [facebookresearch/sonata](https://github.com/facebookresearch/sonata) (CC-BY-NC-4.0)
27
+ - **Library:** [torch-pointcloud](https://github.com/arthurdjn/pytorch-pointcloud)
28
+
29
+ ## Install
30
+
31
+ ```bash
32
+ pip install torch-pointcloud
33
+ ```
34
+
35
+ ## Usage
36
+
37
+ ```python
38
+ import torch
39
+ import torch_pointcloud as tp
40
+ from torch_pointcloud.utils.data import collate
41
+
42
+ model, info = tp.create_model(
43
+ "sonata-base.pretrain.fair",
44
+ task="base",
45
+ pretrained=True,
46
+ return_info=True,
47
+ )
48
+ model = model.cuda().eval() # GPU-only kernels
49
+
50
+ # synthetic sample with the keys a dataset provides
51
+ num_points = 8192
52
+ sample = {
53
+ "pos": torch.randn(num_points, 3),
54
+ "color": torch.rand(num_points, 3) * 255,
55
+ "normal": torch.randn(num_points, 3),
56
+ "segment": torch.zeros(num_points, dtype=torch.long),
57
+ "instance": torch.zeros(num_points, dtype=torch.long),
58
+ }
59
+ data = info["transform"](sample)
60
+ data = collate([data])
61
+ data = {key: value.cuda() for key, value in data.items()}
62
+
63
+ with torch.no_grad():
64
+ out = model(data.get("x"), data["pos_grid"], data["batch"], pos=data["pos"])
65
+ ```
66
+
67
+ ## Citation
68
+
69
+ ```bibtex
70
+ @inproceedings{wu2025sonata,
71
+ title = {Sonata: Self-Supervised Learning of Reliable Point Representations},
72
+ author = {Xiaoyang Wu and Daniel DeTone and Duncan Frost and Tianwei Shen and Chris Xie and Nan Yang and Jakob Engel and Richard Newcombe and Hengshuang Zhao and Julian Straub},
73
+ booktitle = {CVPR},
74
+ year = {2025}
75
+ }
76
+ ```
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df097a27fbd87a671901330fdff1eb55aa37ddf28286f6446f64ff553a0e7960
3
+ size 433890760