Model card for kpfcnn.semantickitti.open3d

A KPConv point cloud semantic segmentation model (deformable kernel point convolution). Trained on SemanticKITTI.

Model Details

• Model Type: Point cloud semantic segmentation
• Model Stats:
  • Params (M): 18.3
  • Input channels: 2
  • Classes: 19
  • Features: 128
• Dataset: SemanticKITTI
• Metrics: mIoU 51.04, OA 91.22
• Paper: KPConv: Flexible and Deformable Convolution for Point Clouds
• Converted from: isl-org/Open3D-ML (MIT)
• Library: torch-pointcloud

Install

pip install torch-pointcloud

Usage

import torch
import torch_pointcloud as tp
from torch_pointcloud.utils.data import collate

model, info = tp.create_model(
    "kpfcnn.semantickitti.open3d",
    pretrained=True,
    return_info=True,
)
model = model.eval()

# synthetic sample with the keys a dataset provides
num_points = 8192
sample = {
    "pos": torch.randn(num_points, 3),
    "intensity": torch.rand(num_points, 1),
    "segment": torch.zeros(num_points, dtype=torch.long),
    "instance": torch.zeros(num_points, dtype=torch.long),
}
data = info["transform"](sample)
data = collate([data])

with torch.no_grad():
    logits = model(data.get("x"), data["pos"], data["batch"])

Feature extraction

with torch.no_grad():
    features = model.forward_features(data.get("x"), data["pos"], data["batch"])

model.reset_classifier(num_classes=0)
with torch.no_grad():
    features = model(data.get("x"), data["pos"], data["batch"])  # (N, 128)

Citation

@inproceedings{thomas2019kpconv,
  title   = {KPConv: Flexible and Deformable Convolution for Point Clouds},
  author  = {Hugues Thomas and Charles R. Qi and Jean-Emmanuel Deschaud and Beatriz Marcotegui and François Goulette and Leonidas J. Guibas},
  booktitle = {ICCV},
  year    = {2019}
}

@inproceedings{behley2019semantickitti,
  title   = {SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences},
  author  = {Jens Behley and Martin Garbade and Andres Milioto and Jan Quenzel and Sven Behnke and Cyrill Stachniss and Juergen Gall},
  booktitle = {ICCV},
  year    = {2019}
}

@software{dujardin2026pytorchpointcloud,
  author  = {Arthur Dujardin},
  title   = {PyTorch PointCloud},
  year    = {2026},
  doi     = {10.5281/zenodo.22159632},
  url     = {https://github.com/arthurdjn/pytorch-pointcloud},
}