ZhaochongAn
commited on
Commit
·
f455990
1
Parent(s):
2d3d27d
weights release
Browse files- README.md +44 -0
- backbone_weights/scannet/model_best.pth +3 -0
- backbone_weights/scannet200/model_best.pth +3 -0
- backbone_weights/scannetpp/model_best.pth +3 -0
- sc200_k1/regis1_model_last.pth +3 -0
- sc200_k1/regis2_model_last.pth +3 -0
- sc200_k1/regis3_model_last.pth +3 -0
- sc200_k1/regis4_model_last.pth +3 -0
- sc200_k1/regis5_model_last.pth +3 -0
- sc200_k5/regis1_model_last.pth +3 -0
- sc200_k5/regis2_model_last.pth +3 -0
- sc200_k5/regis3_model_last.pth +3 -0
- sc200_k5/regis4_model_last.pth +3 -0
- sc200_k5/regis5_model_last.pth +3 -0
- sc_k1/regis1_model_last.pth +3 -0
- sc_k1/regis2_model_last.pth +3 -0
- sc_k1/regis3_model_last.pth +3 -0
- sc_k1/regis4_model_last.pth +3 -0
- sc_k1/regis5_model_last.pth +3 -0
- sc_k5/regis1_model_last.pth +3 -0
- sc_k5/regis2_model_last.pth +3 -0
- sc_k5/regis3_model_last.pth +3 -0
- sc_k5/regis4_model_last.pth +3 -0
- sc_k5/regis5_model_last.pth +3 -0
- scpp_k1/regis1_model_last.pth +3 -0
- scpp_k1/regis2_model_last.pth +3 -0
- scpp_k1/regis3_model_last.pth +3 -0
- scpp_k1/regis4_model_last.pth +3 -0
- scpp_k1/regis5_model_last.pth +3 -0
- scpp_k5/regis1_model_last.pth +3 -0
- scpp_k5/regis2_model_last.pth +3 -0
- scpp_k5/regis3_model_last.pth +3 -0
- scpp_k5/regis4_model_last.pth +3 -0
- scpp_k5/regis5_model_last.pth +3 -0
README.md
ADDED
|
@@ -0,0 +1,44 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# [CVPR 2025] GFS-VL: Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model
|
| 6 |
+
|
| 7 |
+
## Overview
|
| 8 |
+
|
| 9 |
+
GFS-VL is a novel framework proposed in our CVPR 2025 paper: [**Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model**](https://arxiv.org/pdf/2503.16282).
|
| 10 |
+
|
| 11 |
+
Our approach leverages the synergy between:
|
| 12 |
+
- **Dense but noisy pseudo-labels** from 3D Vision-Language Models
|
| 13 |
+
- **Precise yet sparse few-shot samples**
|
| 14 |
+
|
| 15 |
+
by maximizing the strengths of both data sources for effective generalized few-shot 3D point cloud segmentation.
|
| 16 |
+
|
| 17 |
+
## Released Model Weights
|
| 18 |
+
|
| 19 |
+
This repository contains the following pre-trained weights:
|
| 20 |
+
- **PTv3 Backbones**: Our pre-trained point transformer v3 backbones
|
| 21 |
+
- **GFS-VL Models**: Complete GFS_VL few-shot segmentation framework
|
| 22 |
+
|
| 23 |
+
## Usage
|
| 24 |
+
|
| 25 |
+
For detailed usage instructions, model implementation, and training code, please refer to our [GitHub repository](https://github.com/ZhaochongAn/GFS-VL).
|
| 26 |
+
|
| 27 |
+
## Benchmarks
|
| 28 |
+
|
| 29 |
+
We introduce **two new challenging GFS-PCS benchmarks** with diverse novel classes for comprehensive generalization evaluation. These benchmarks lay a solid foundation for real-world GFS-PCS advancements.
|
| 30 |
+
|
| 31 |
+
The benchmark datasets can be downloaded from our [Huggingface dataset repository](https://github.com/ZhaochongAn/GFS-VL).
|
| 32 |
+
|
| 33 |
+
## Citation
|
| 34 |
+
|
| 35 |
+
If you find our work useful, please consider citing our paper:
|
| 36 |
+
|
| 37 |
+
```bibtex
|
| 38 |
+
@inproceedings{an2025generalized,
|
| 39 |
+
title={Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model},
|
| 40 |
+
author={An, Zhaochong and Sun, Guolei and Liu, Yun and Li, Runjia and Han, Junlin and Konukoglu, Ender and Belongie, Serge},
|
| 41 |
+
booktitle=CVPR,
|
| 42 |
+
year={2025}
|
| 43 |
+
}
|
| 44 |
+
```
|
backbone_weights/scannet/model_best.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:65f373505cfdbd158f53dc6e1f9c6f0c726b3bea45c9f0a5b31fcc2ffa200737
|
| 3 |
+
size 554612520
|
backbone_weights/scannet200/model_best.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09f5f6ceb08c2b93c657349e66f45bfbe9c59bc78235a1d4ec66bd55b4233301
|
| 3 |
+
size 554611752
|
backbone_weights/scannetpp/model_best.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:003fc00b31ab2f19e0890fe9e58ee50e827aa6173cf3763aac6b6de854195bb1
|
| 3 |
+
size 554611752
|
sc200_k1/regis1_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20b9305f4fa6745c5b23b5579aeca88e52cc5674e3cec60eabe0e84366f3b80a
|
| 3 |
+
size 554598021
|
sc200_k1/regis2_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:beda9af3f9ad20b7308238af157e89f750b1e931d9d9b75093843f3e72c1234b
|
| 3 |
+
size 554598021
|
sc200_k1/regis3_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1260f9d1cfe681288d34b512044d6cec606282e8625912a867e9b02d51f674e4
|
| 3 |
+
size 554598021
|
sc200_k1/regis4_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5f2edb6ecf022cc329ab2e15aaa704d223f5d5f3d31a1b06855fa3eca10daae0
|
| 3 |
+
size 554598021
|
sc200_k1/regis5_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:971ff3e27989c252a7595c658fa9eccd48c444153952c6a1a20699799a337aad
|
| 3 |
+
size 554598021
|
sc200_k5/regis1_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cc882707e9fe812784824f450b2e12cf4fd4ead30923152fe71b0c821394a0b6
|
| 3 |
+
size 554598021
|
sc200_k5/regis2_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:99a6a4ba0a9684c4ef4d2ac17fe229c8bdae456846ab34619cf47ed58c29c726
|
| 3 |
+
size 554598021
|
sc200_k5/regis3_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b0f7facacb9ecbdd99f7788bd655bd00e421e4f66c5946acd788beefcaa49e69
|
| 3 |
+
size 554598021
|
sc200_k5/regis4_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:69d531052741cb7476c88e96115bfc46a43825e1fcc60a490580cb912373afb8
|
| 3 |
+
size 554598021
|
sc200_k5/regis5_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1102bd23faba50f85c3c25568fc5689ecb72c2a35994b73a9f041e6c0f69498
|
| 3 |
+
size 554598021
|
sc_k1/regis1_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d80187dc08187edf8b47fdecd093127029f572069058a3a37ede0c92f48af71
|
| 3 |
+
size 554568965
|
sc_k1/regis2_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8509e5bc880e1ec4a5c06f3a652a73ffc3f719d1bacd1f9d8acbeef469860e72
|
| 3 |
+
size 554568965
|
sc_k1/regis3_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20c8ad453c965044495eaa01eef1b78ee2492157967521a97a59210606f9cf26
|
| 3 |
+
size 554568965
|
sc_k1/regis4_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f25a9d5b0f103f6f6e6072c9926abbf34d260d4daaf8ceff6b2934e9c7ea54e5
|
| 3 |
+
size 554568965
|
sc_k1/regis5_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:efd29496903a07993ee475c95bb8e332eded99d569bb2d10aea49e8694d5890d
|
| 3 |
+
size 554568965
|
sc_k5/regis1_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:87340c6e5d4b8615249a9b2468b1c1e018532b10bc0e2f6d5a2f163932d400fb
|
| 3 |
+
size 554568965
|
sc_k5/regis2_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9a1e810400f97076df05e846e43928e8065962cf000411ff4f868e4d63c6bcd5
|
| 3 |
+
size 554568965
|
sc_k5/regis3_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a68054124e69e0517b9a4f4d20e502ee470ccc5fb5e8272ff50a2d923fc90c2d
|
| 3 |
+
size 554568965
|
sc_k5/regis4_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:781c06ffad97042216764a81de90a1d444c3699cf8055f2c75d9c94567cc93ac
|
| 3 |
+
size 554568965
|
sc_k5/regis5_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d85eaa44d80b021c3571d154fc1bdda446f2fdbff3ca010875c985f7437ccf36
|
| 3 |
+
size 554568965
|
scpp_k1/regis1_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:158d2b7ece8a39b6699ce1c1e224242b6b82fb6b44225efc33b4759a0930d0f1
|
| 3 |
+
size 554577285
|
scpp_k1/regis2_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:40ba6cd56116b7ab9111f8ae32bb206eae0a2fcab3bc9b2b7115e1ad1cbb83ca
|
| 3 |
+
size 554577285
|
scpp_k1/regis3_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cabdf7b882027a3f010c58ded80b39784014837d1fc71c08085f5ed82590883f
|
| 3 |
+
size 554577285
|
scpp_k1/regis4_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:36fa736f597e9b5d157f905a64f97706a10281610f97b66c21e307d1dc2b0ed5
|
| 3 |
+
size 554577285
|
scpp_k1/regis5_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1421f5e18153533f639d6e9eab9a46bff1d6c1ec3a3d519f2d93178c4e69003e
|
| 3 |
+
size 554577285
|
scpp_k5/regis1_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9e2de26e1901b4e618c34161042f68c7554a75f8d5d91de4557ab4ca93797fdd
|
| 3 |
+
size 554577285
|
scpp_k5/regis2_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1bd21ef0e468672392fc2de06e5e011dbdd8662d8fa5223b120219e9e7b0e93f
|
| 3 |
+
size 554577285
|
scpp_k5/regis3_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:db575a145cc23b34245596a1699d5ca20a1020b880274afe2542b19b2034cd75
|
| 3 |
+
size 554577285
|
scpp_k5/regis4_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:42f9402e8d57760f28e01d566793d1bebcb44e30dfd0d96a049a5c235ce4dcaa
|
| 3 |
+
size 554577285
|
scpp_k5/regis5_model_last.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6ce7b188232c1bf0e249c616861848020a10228a818a71cbbb88bacb64d90c27
|
| 3 |
+
size 554577285
|