Upload 3 files
Browse files- CITATION.cff +62 -0
- MODEL_CARD.md +83 -0
- README.md +156 -2
CITATION.cff
ADDED
|
@@ -0,0 +1,62 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
cff-version: 1.2.0
|
| 2 |
+
type: dataset
|
| 3 |
+
title: "FLKD 3D Benchmark: Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification"
|
| 4 |
+
authors:
|
| 5 |
+
- family-names: "Aiersilan"
|
| 6 |
+
given-names: "Aizierjiang"
|
| 7 |
+
version: 1.0.0
|
| 8 |
+
date-released: 2026-06-29
|
| 9 |
+
description: "Pre-trained models and experimental results from the comprehensive benchmark evaluating 13 Federated Learning algorithms, 11 Knowledge Distillation objectives, and their combinations on 3D point cloud classification tasks, specifically on the Craniosynostosis medical dataset. This collection includes model checkpoints, training logs, metrics, and configurations for reproducible research in federated learning and knowledge distillation for 3D deep learning."
|
| 10 |
+
keywords:
|
| 11 |
+
- federated-learning
|
| 12 |
+
- knowledge-distillation
|
| 13 |
+
- point-cloud
|
| 14 |
+
- 3d-classification
|
| 15 |
+
- benchmarking
|
| 16 |
+
- deep-learning
|
| 17 |
+
- privacy-preserving-ml
|
| 18 |
+
- distributed-training
|
| 19 |
+
license: MIT
|
| 20 |
+
repository-code: "https://github.com/Ezharjan/FLKD3DBenchmark"
|
| 21 |
+
url: "https://ezharjan.github.io/FLKD3DBenchmark"
|
| 22 |
+
references:
|
| 23 |
+
- type: conference-paper
|
| 24 |
+
authors:
|
| 25 |
+
- family-names: "Aiersilan"
|
| 26 |
+
given-names: "Aizierjiang"
|
| 27 |
+
title: "Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification"
|
| 28 |
+
conference:
|
| 29 |
+
name: "European Conference on Computer Vision"
|
| 30 |
+
acronym: "ECCV"
|
| 31 |
+
year: 2026
|
| 32 |
+
publisher:
|
| 33 |
+
name: "Springer"
|
| 34 |
+
doi: "10.1007/XXX-X-XXX-XXXXX-X"
|
| 35 |
+
contact:
|
| 36 |
+
- type: person
|
| 37 |
+
name: "Aizierjiang Aiersilan"
|
| 38 |
+
email: "alx.laboratory@gmail.com"
|
| 39 |
+
|
| 40 |
+
# Usage & Citation Information
|
| 41 |
+
# ==============================
|
| 42 |
+
#
|
| 43 |
+
# If you use this dataset or models in your research, please cite the original paper:
|
| 44 |
+
#
|
| 45 |
+
# BibTeX format:
|
| 46 |
+
# @inproceedings{aizierjiang26benchmark,
|
| 47 |
+
# title={Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification},
|
| 48 |
+
# author={Aizierjiang Aiersilan},
|
| 49 |
+
# booktitle={European Conference on Computer Vision},
|
| 50 |
+
# organization={Springer},
|
| 51 |
+
# year={2026}
|
| 52 |
+
# }
|
| 53 |
+
#
|
| 54 |
+
# Chicago style:
|
| 55 |
+
# Aiersilan, Aizierjiang. "Benchmarking Federated Learning and Knowledge Distillation
|
| 56 |
+
# for Point Cloud Classification." Presented at the European Conference on Computer Vision, 2026.
|
| 57 |
+
#
|
| 58 |
+
# APA style:
|
| 59 |
+
# Aiersilan, A. (2026). Benchmarking federated learning and knowledge distillation for
|
| 60 |
+
# point cloud classification. In European Conference on Computer Vision. Springer.
|
| 61 |
+
#
|
| 62 |
+
# We appreciate your citation! It helps us track usage and improve future work.
|
MODEL_CARD.md
ADDED
|
@@ -0,0 +1,83 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Model Card: FLKD Point Cloud Classification Benchmark
|
| 2 |
+
|
| 3 |
+
## Model Details
|
| 4 |
+
|
| 5 |
+
### Model Family
|
| 6 |
+
PointNet++ (Single-Scale Grouping) with optional Federated Learning + Knowledge Distillation training
|
| 7 |
+
|
| 8 |
+
### Model Variants
|
| 9 |
+
- **Classical**: Standard centralized training
|
| 10 |
+
- **Federated**: Trained via 13 different federated learning algorithms (FedAvg, FedProx, SCAFFOLD, FedDyn, FedAvgM, FedAdam, FedYogi, FedAdagrad, FedMedian, FedBN, MOON, Ditto, FedNova)
|
| 11 |
+
|
| 12 |
+
### Input/Output
|
| 13 |
+
|
| 14 |
+
**Input**:
|
| 15 |
+
- 3D point clouds with variable number of points (typically 1024 points)
|
| 16 |
+
- Float32 tensors of shape (batch_size, num_points, 3)
|
| 17 |
+
|
| 18 |
+
**Output**:
|
| 19 |
+
- Class logits for binary classification (2 classes)
|
| 20 |
+
- Softmax probabilities for disease classification
|
| 21 |
+
|
| 22 |
+
## Intended Use
|
| 23 |
+
|
| 24 |
+
These models are designed for **3D point cloud classification**. They serve as benchmarks for evaluating:
|
| 25 |
+
|
| 26 |
+
1. **Federated Learning** effectiveness on 3D data with heterogeneous client distributions
|
| 27 |
+
2. **Knowledge Distillation** techniques applied to point cloud models
|
| 28 |
+
3. **Combined FL+KD** approaches for privacy-preserving distributed training
|
| 29 |
+
4. **Model performance variance** across multiple random seeds
|
| 30 |
+
|
| 31 |
+
### Primary Use Cases
|
| 32 |
+
- Research on federated learning for 3D deep learning
|
| 33 |
+
- Comparison of knowledge distillation losses on distributed systems
|
| 34 |
+
- Benchmark reference for new FL/KD algorithms on 3D data
|
| 35 |
+
|
| 36 |
+
|
| 37 |
+
## Model Performance
|
| 38 |
+
|
| 39 |
+
|
| 40 |
+
## Hardware & Training
|
| 41 |
+
|
| 42 |
+
### Training Environment
|
| 43 |
+
- **GPU**: NVIDIA GPUs; compatible with newer CUDA architectures
|
| 44 |
+
- **Distributed**: Single-GPU per job; parallel jobs via SLURM job arrays
|
| 45 |
+
- **Framework**: PyTorch 2.0+
|
| 46 |
+
## Recommendations
|
| 47 |
+
|
| 48 |
+
### How to Use
|
| 49 |
+
1. Load `best_model.pth` for production inference
|
| 50 |
+
2. Preprocess input point clouds to match training data distribution
|
| 51 |
+
3. Use model in evaluation mode (`model.eval()`) for inference
|
| 52 |
+
4. Report metrics across multiple seeds for reproducibility
|
| 53 |
+
|
| 54 |
+
### How to Cite
|
| 55 |
+
When using these models, please cite the original paper and dataset:
|
| 56 |
+
|
| 57 |
+
```bibtex
|
| 58 |
+
@inproceedings{aizierjiang26benchmark,
|
| 59 |
+
title={Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification},
|
| 60 |
+
author={Aizierjiang Aiersilan},
|
| 61 |
+
booktitle={European Conference on Computer Vision},
|
| 62 |
+
organization={Springer},
|
| 63 |
+
year={2026}
|
| 64 |
+
}
|
| 65 |
+
```
|
| 66 |
+
|
| 67 |
+
## Versioning
|
| 68 |
+
|
| 69 |
+
- **Model Version**: 1.0 (ECCV 2026 publication)
|
| 70 |
+
- **Framework**: PyTorch 2.0+
|
| 71 |
+
- **Python Version**: 3.10+
|
| 72 |
+
|
| 73 |
+
## Contact & Support
|
| 74 |
+
|
| 75 |
+
For questions about these models, please visit:
|
| 76 |
+
- **Project Website**: https://ezharjan.github.io/FLKD3DBenchmark/
|
| 77 |
+
- **GitHub Repository**: https://github.com/Ezharjan/FLKD3DBenchmark/
|
| 78 |
+
|
| 79 |
+
---
|
| 80 |
+
|
| 81 |
+
**Model Card Last Updated**: June 2026
|
| 82 |
+
**Model Type**: Supervised Classification (3D Point Clouds)
|
| 83 |
+
**Task**: Federated Learning + Knowledge Distillation Benchmark
|
README.md
CHANGED
|
@@ -1,3 +1,157 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
-
|
| 3 |
-
|
|
|
|
| 1 |
+
# FLKD 3D Benchmark - Output Models and Results
|
| 2 |
+
|
| 3 |
+
This directory contains pre-trained models and comprehensive results from the **Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification** benchmark (ECCV 2026).
|
| 4 |
+
|
| 5 |
+
## Overview
|
| 6 |
+
|
| 7 |
+
This collection includes trained PointNet++ models evaluated on the 3D point cloud datasets across two training paradigms:
|
| 8 |
+
|
| 9 |
+
- **Classical Training**: Centralized, single-machine model training
|
| 10 |
+
- **Federated Learning + Knowledge Distillation (FLKD)**: Distributed federated learning with knowledge distillation objectives
|
| 11 |
+
|
| 12 |
+
All experiments were conducted with multiple random seeds to ensure robust statistical reporting of performance metrics.
|
| 13 |
+
|
| 14 |
+
## Directory Structure
|
| 15 |
+
|
| 16 |
+
```
|
| 17 |
+
RootDir/
|
| 18 |
+
βββ <dataset_name></dataset_name>/
|
| 19 |
+
βββ classification/
|
| 20 |
+
β βββ pointnet2_cls_ssg_s{seed}/
|
| 21 |
+
β βββ checkpoints/
|
| 22 |
+
β β βββ best_model.pth
|
| 23 |
+
β β βββ last_model.pth
|
| 24 |
+
β β βββ resume.pth
|
| 25 |
+
β βββ config.json
|
| 26 |
+
β βββ logs/
|
| 27 |
+
β β βββ train.log
|
| 28 |
+
β βββ metrics.jsonl
|
| 29 |
+
β
|
| 30 |
+
βββ flkd/federated/classification/
|
| 31 |
+
βββ fl_pointnet2_cls_ssg_{algorithm}_s{seed}/
|
| 32 |
+
βββ checkpoints/
|
| 33 |
+
β βββ best_model.pth
|
| 34 |
+
β βββ last_model.pth
|
| 35 |
+
β βββ resume.pth
|
| 36 |
+
βββ config.json
|
| 37 |
+
βββ logs/
|
| 38 |
+
β βββ train.log
|
| 39 |
+
βββ metrics.jsonl
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
## File Descriptions
|
| 43 |
+
|
| 44 |
+
### Checkpoints
|
| 45 |
+
- **best_model.pth**: Model weights achieving the highest validation accuracy during training
|
| 46 |
+
- **last_model.pth**: Model weights from the final training round/epoch
|
| 47 |
+
- **resume.pth**: Complete training state (model, optimizer, RNG) for resuming interrupted training
|
| 48 |
+
|
| 49 |
+
### Configuration
|
| 50 |
+
- **config.json**: Hyperparameters, dataset splits, model architecture, and training settings used for this experiment
|
| 51 |
+
|
| 52 |
+
### Logs
|
| 53 |
+
- **train.log**: Detailed per-epoch/round training logs including loss values and validation metrics
|
| 54 |
+
|
| 55 |
+
### Metrics
|
| 56 |
+
- **metrics.jsonl**: Machine-readable results in JSONL format containing:
|
| 57 |
+
- Per-epoch/round accuracy metrics
|
| 58 |
+
- Loss values
|
| 59 |
+
- Training time information
|
| 60 |
+
- Other performance indicators
|
| 61 |
+
|
| 62 |
+
## Seeds and Reproducibility
|
| 63 |
+
|
| 64 |
+
Experiments use multiple random seeds (e.g., s7, s42, s123) to report mean Β± standard deviation statistics, ensuring robust statistical conclusions. Load `best_model.pth` for production use; consult `metrics.jsonl` for full seed-wise performance breakdowns.
|
| 65 |
+
|
| 66 |
+
## Federated Learning Algorithms
|
| 67 |
+
|
| 68 |
+
The FLKD benchmark evaluates these 13 FL algorithms:
|
| 69 |
+
- **FedAvg**: Classical federated averaging (also called "vanilla")
|
| 70 |
+
- **FedProx**: Proximal term regularization for heterogeneous local objectives
|
| 71 |
+
- **SCAFFOLD**: Control variates to reduce client drift
|
| 72 |
+
- **FedDyn**: Biased aggregation with consensus optimization
|
| 73 |
+
- **FedAvgM**: Momentum-based federated averaging
|
| 74 |
+
- **FedAdam**: Server-side adaptive learning rates (Adam variant)
|
| 75 |
+
- **FedYogi**: Server-side adaptive learning rates (Yogi variant)
|
| 76 |
+
- **FedAdagrad**: Server-side adaptive learning rates (AdaGrad variant)
|
| 77 |
+
- **FedMedian**: Robust aggregation via median
|
| 78 |
+
- **FedBN**: Batch norm personalization for heterogeneous local data
|
| 79 |
+
- **MOON**: Contrastive learning to maintain consistency
|
| 80 |
+
- **Ditto**: Explicit client-local personalization
|
| 81 |
+
- **FedNova**: Normalized aggregation for non-IID data
|
| 82 |
+
|
| 83 |
+
|
| 84 |
+
## Model Architecture
|
| 85 |
+
|
| 86 |
+
**PointNet++ (Single-Scale Grouping / SSG)**:
|
| 87 |
+
- Multi-layer hierarchical feature learning on point clouds
|
| 88 |
+
- Set Abstraction (SA) layers with ball query and PointNet modules
|
| 89 |
+
- Feature Propagation (FP) layers for upsampling
|
| 90 |
+
- Designed for robust 3D shape understanding
|
| 91 |
+
|
| 92 |
+
## Usage
|
| 93 |
+
|
| 94 |
+
### Loading a Model
|
| 95 |
+
|
| 96 |
+
```python
|
| 97 |
+
import torch
|
| 98 |
+
|
| 99 |
+
# Load the best model for a specific configuration
|
| 100 |
+
model = torch.load('pointnet2_cls_ssg_s123/checkpoints/best_model.pth')
|
| 101 |
+
|
| 102 |
+
# Or load with full training state (for resuming)
|
| 103 |
+
checkpoint = torch.load('pointnet2_cls_ssg_s123/checkpoints/resume.pth')
|
| 104 |
+
model_state = checkpoint['model_state']
|
| 105 |
+
optimizer_state = checkpoint['optimizer_state']
|
| 106 |
+
```
|
| 107 |
+
|
| 108 |
+
### Accessing Results
|
| 109 |
+
|
| 110 |
+
```python
|
| 111 |
+
import json
|
| 112 |
+
|
| 113 |
+
# Load configuration
|
| 114 |
+
with open('pointnet2_cls_ssg_s123/config.json') as f:
|
| 115 |
+
config = json.load(f)
|
| 116 |
+
|
| 117 |
+
# Read metrics (each line is a JSON object)
|
| 118 |
+
with open('pointnet2_cls_ssg_s123/metrics.jsonl') as f:
|
| 119 |
+
for line in f:
|
| 120 |
+
epoch_metrics = json.loads(line)
|
| 121 |
+
print(epoch_metrics)
|
| 122 |
+
```
|
| 123 |
+
|
| 124 |
+
## Citation
|
| 125 |
+
|
| 126 |
+
If you use these models or results, please cite the original paper:
|
| 127 |
+
|
| 128 |
+
```bibtex
|
| 129 |
+
@inproceedings{aizierjiang26benchmark,
|
| 130 |
+
title={Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification},
|
| 131 |
+
author={Aizierjiang Aiersilan},
|
| 132 |
+
booktitle={European Conference on Computer Vision},
|
| 133 |
+
organization={Springer},
|
| 134 |
+
year={2026}
|
| 135 |
+
}
|
| 136 |
+
```
|
| 137 |
+
|
| 138 |
+
## License
|
| 139 |
+
|
| 140 |
+
The models and code follow the project's original license. Please refer to the main repository for detailed license information.
|
| 141 |
+
|
| 142 |
+
## Additional Resources
|
| 143 |
+
|
| 144 |
+
- **Project Website**: https://ezharjan.github.io/FLKD3DBenchmark/
|
| 145 |
+
- **Main Repository**: https://github.com/Ezharjan/FLKD3DBenchmark/
|
| 146 |
+
- **Paper**: Available at the project website
|
| 147 |
+
|
| 148 |
+
## Notes
|
| 149 |
+
|
| 150 |
+
- All models were trained using PyTorch with CUDA acceleration
|
| 151 |
+
- Mixed precision (bf16) was applied where supported; exact fp32 on high performance GPUs
|
| 152 |
+
- Auto-resume checkpoints enable resuming interrupted training without loss of progress
|
| 153 |
+
- Metrics are reported as mean Β± std across multiple random seeds for robust statistical assessment
|
| 154 |
+
|
| 155 |
---
|
| 156 |
+
|
| 157 |
+
For questions, issues, or to contribute improvements, please visit the main repository or contact the authors through the project website.
|