ezharjan commited on
Commit
ac58397
Β·
verified Β·
1 Parent(s): 06e4ba9

Upload 3 files

Browse files
Files changed (3) hide show
  1. CITATION.cff +62 -0
  2. MODEL_CARD.md +83 -0
  3. README.md +156 -2
CITATION.cff ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ cff-version: 1.2.0
2
+ type: dataset
3
+ title: "FLKD 3D Benchmark: Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification"
4
+ authors:
5
+ - family-names: "Aiersilan"
6
+ given-names: "Aizierjiang"
7
+ version: 1.0.0
8
+ date-released: 2026-06-29
9
+ description: "Pre-trained models and experimental results from the comprehensive benchmark evaluating 13 Federated Learning algorithms, 11 Knowledge Distillation objectives, and their combinations on 3D point cloud classification tasks, specifically on the Craniosynostosis medical dataset. This collection includes model checkpoints, training logs, metrics, and configurations for reproducible research in federated learning and knowledge distillation for 3D deep learning."
10
+ keywords:
11
+ - federated-learning
12
+ - knowledge-distillation
13
+ - point-cloud
14
+ - 3d-classification
15
+ - benchmarking
16
+ - deep-learning
17
+ - privacy-preserving-ml
18
+ - distributed-training
19
+ license: MIT
20
+ repository-code: "https://github.com/Ezharjan/FLKD3DBenchmark"
21
+ url: "https://ezharjan.github.io/FLKD3DBenchmark"
22
+ references:
23
+ - type: conference-paper
24
+ authors:
25
+ - family-names: "Aiersilan"
26
+ given-names: "Aizierjiang"
27
+ title: "Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification"
28
+ conference:
29
+ name: "European Conference on Computer Vision"
30
+ acronym: "ECCV"
31
+ year: 2026
32
+ publisher:
33
+ name: "Springer"
34
+ doi: "10.1007/XXX-X-XXX-XXXXX-X"
35
+ contact:
36
+ - type: person
37
+ name: "Aizierjiang Aiersilan"
38
+ email: "alx.laboratory@gmail.com"
39
+
40
+ # Usage & Citation Information
41
+ # ==============================
42
+ #
43
+ # If you use this dataset or models in your research, please cite the original paper:
44
+ #
45
+ # BibTeX format:
46
+ # @inproceedings{aizierjiang26benchmark,
47
+ # title={Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification},
48
+ # author={Aizierjiang Aiersilan},
49
+ # booktitle={European Conference on Computer Vision},
50
+ # organization={Springer},
51
+ # year={2026}
52
+ # }
53
+ #
54
+ # Chicago style:
55
+ # Aiersilan, Aizierjiang. "Benchmarking Federated Learning and Knowledge Distillation
56
+ # for Point Cloud Classification." Presented at the European Conference on Computer Vision, 2026.
57
+ #
58
+ # APA style:
59
+ # Aiersilan, A. (2026). Benchmarking federated learning and knowledge distillation for
60
+ # point cloud classification. In European Conference on Computer Vision. Springer.
61
+ #
62
+ # We appreciate your citation! It helps us track usage and improve future work.
MODEL_CARD.md ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Model Card: FLKD Point Cloud Classification Benchmark
2
+
3
+ ## Model Details
4
+
5
+ ### Model Family
6
+ PointNet++ (Single-Scale Grouping) with optional Federated Learning + Knowledge Distillation training
7
+
8
+ ### Model Variants
9
+ - **Classical**: Standard centralized training
10
+ - **Federated**: Trained via 13 different federated learning algorithms (FedAvg, FedProx, SCAFFOLD, FedDyn, FedAvgM, FedAdam, FedYogi, FedAdagrad, FedMedian, FedBN, MOON, Ditto, FedNova)
11
+
12
+ ### Input/Output
13
+
14
+ **Input**:
15
+ - 3D point clouds with variable number of points (typically 1024 points)
16
+ - Float32 tensors of shape (batch_size, num_points, 3)
17
+
18
+ **Output**:
19
+ - Class logits for binary classification (2 classes)
20
+ - Softmax probabilities for disease classification
21
+
22
+ ## Intended Use
23
+
24
+ These models are designed for **3D point cloud classification**. They serve as benchmarks for evaluating:
25
+
26
+ 1. **Federated Learning** effectiveness on 3D data with heterogeneous client distributions
27
+ 2. **Knowledge Distillation** techniques applied to point cloud models
28
+ 3. **Combined FL+KD** approaches for privacy-preserving distributed training
29
+ 4. **Model performance variance** across multiple random seeds
30
+
31
+ ### Primary Use Cases
32
+ - Research on federated learning for 3D deep learning
33
+ - Comparison of knowledge distillation losses on distributed systems
34
+ - Benchmark reference for new FL/KD algorithms on 3D data
35
+
36
+
37
+ ## Model Performance
38
+
39
+
40
+ ## Hardware & Training
41
+
42
+ ### Training Environment
43
+ - **GPU**: NVIDIA GPUs; compatible with newer CUDA architectures
44
+ - **Distributed**: Single-GPU per job; parallel jobs via SLURM job arrays
45
+ - **Framework**: PyTorch 2.0+
46
+ ## Recommendations
47
+
48
+ ### How to Use
49
+ 1. Load `best_model.pth` for production inference
50
+ 2. Preprocess input point clouds to match training data distribution
51
+ 3. Use model in evaluation mode (`model.eval()`) for inference
52
+ 4. Report metrics across multiple seeds for reproducibility
53
+
54
+ ### How to Cite
55
+ When using these models, please cite the original paper and dataset:
56
+
57
+ ```bibtex
58
+ @inproceedings{aizierjiang26benchmark,
59
+ title={Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification},
60
+ author={Aizierjiang Aiersilan},
61
+ booktitle={European Conference on Computer Vision},
62
+ organization={Springer},
63
+ year={2026}
64
+ }
65
+ ```
66
+
67
+ ## Versioning
68
+
69
+ - **Model Version**: 1.0 (ECCV 2026 publication)
70
+ - **Framework**: PyTorch 2.0+
71
+ - **Python Version**: 3.10+
72
+
73
+ ## Contact & Support
74
+
75
+ For questions about these models, please visit:
76
+ - **Project Website**: https://ezharjan.github.io/FLKD3DBenchmark/
77
+ - **GitHub Repository**: https://github.com/Ezharjan/FLKD3DBenchmark/
78
+
79
+ ---
80
+
81
+ **Model Card Last Updated**: June 2026
82
+ **Model Type**: Supervised Classification (3D Point Clouds)
83
+ **Task**: Federated Learning + Knowledge Distillation Benchmark
README.md CHANGED
@@ -1,3 +1,157 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- license: mit
3
- ---
 
1
+ # FLKD 3D Benchmark - Output Models and Results
2
+
3
+ This directory contains pre-trained models and comprehensive results from the **Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification** benchmark (ECCV 2026).
4
+
5
+ ## Overview
6
+
7
+ This collection includes trained PointNet++ models evaluated on the 3D point cloud datasets across two training paradigms:
8
+
9
+ - **Classical Training**: Centralized, single-machine model training
10
+ - **Federated Learning + Knowledge Distillation (FLKD)**: Distributed federated learning with knowledge distillation objectives
11
+
12
+ All experiments were conducted with multiple random seeds to ensure robust statistical reporting of performance metrics.
13
+
14
+ ## Directory Structure
15
+
16
+ ```
17
+ RootDir/
18
+ └── <dataset_name></dataset_name>/
19
+ β”œβ”€β”€ classification/
20
+ β”‚ └── pointnet2_cls_ssg_s{seed}/
21
+ β”‚ β”œβ”€β”€ checkpoints/
22
+ β”‚ β”‚ β”œβ”€β”€ best_model.pth
23
+ β”‚ β”‚ β”œβ”€β”€ last_model.pth
24
+ β”‚ β”‚ └── resume.pth
25
+ β”‚ β”œβ”€β”€ config.json
26
+ β”‚ β”œβ”€β”€ logs/
27
+ β”‚ β”‚ └── train.log
28
+ β”‚ └── metrics.jsonl
29
+ β”‚
30
+ └── flkd/federated/classification/
31
+ └── fl_pointnet2_cls_ssg_{algorithm}_s{seed}/
32
+ β”œβ”€β”€ checkpoints/
33
+ β”‚ β”œβ”€β”€ best_model.pth
34
+ β”‚ β”œβ”€β”€ last_model.pth
35
+ β”‚ └── resume.pth
36
+ β”œβ”€β”€ config.json
37
+ β”œβ”€β”€ logs/
38
+ β”‚ └── train.log
39
+ └── metrics.jsonl
40
+ ```
41
+
42
+ ## File Descriptions
43
+
44
+ ### Checkpoints
45
+ - **best_model.pth**: Model weights achieving the highest validation accuracy during training
46
+ - **last_model.pth**: Model weights from the final training round/epoch
47
+ - **resume.pth**: Complete training state (model, optimizer, RNG) for resuming interrupted training
48
+
49
+ ### Configuration
50
+ - **config.json**: Hyperparameters, dataset splits, model architecture, and training settings used for this experiment
51
+
52
+ ### Logs
53
+ - **train.log**: Detailed per-epoch/round training logs including loss values and validation metrics
54
+
55
+ ### Metrics
56
+ - **metrics.jsonl**: Machine-readable results in JSONL format containing:
57
+ - Per-epoch/round accuracy metrics
58
+ - Loss values
59
+ - Training time information
60
+ - Other performance indicators
61
+
62
+ ## Seeds and Reproducibility
63
+
64
+ Experiments use multiple random seeds (e.g., s7, s42, s123) to report mean Β± standard deviation statistics, ensuring robust statistical conclusions. Load `best_model.pth` for production use; consult `metrics.jsonl` for full seed-wise performance breakdowns.
65
+
66
+ ## Federated Learning Algorithms
67
+
68
+ The FLKD benchmark evaluates these 13 FL algorithms:
69
+ - **FedAvg**: Classical federated averaging (also called "vanilla")
70
+ - **FedProx**: Proximal term regularization for heterogeneous local objectives
71
+ - **SCAFFOLD**: Control variates to reduce client drift
72
+ - **FedDyn**: Biased aggregation with consensus optimization
73
+ - **FedAvgM**: Momentum-based federated averaging
74
+ - **FedAdam**: Server-side adaptive learning rates (Adam variant)
75
+ - **FedYogi**: Server-side adaptive learning rates (Yogi variant)
76
+ - **FedAdagrad**: Server-side adaptive learning rates (AdaGrad variant)
77
+ - **FedMedian**: Robust aggregation via median
78
+ - **FedBN**: Batch norm personalization for heterogeneous local data
79
+ - **MOON**: Contrastive learning to maintain consistency
80
+ - **Ditto**: Explicit client-local personalization
81
+ - **FedNova**: Normalized aggregation for non-IID data
82
+
83
+
84
+ ## Model Architecture
85
+
86
+ **PointNet++ (Single-Scale Grouping / SSG)**:
87
+ - Multi-layer hierarchical feature learning on point clouds
88
+ - Set Abstraction (SA) layers with ball query and PointNet modules
89
+ - Feature Propagation (FP) layers for upsampling
90
+ - Designed for robust 3D shape understanding
91
+
92
+ ## Usage
93
+
94
+ ### Loading a Model
95
+
96
+ ```python
97
+ import torch
98
+
99
+ # Load the best model for a specific configuration
100
+ model = torch.load('pointnet2_cls_ssg_s123/checkpoints/best_model.pth')
101
+
102
+ # Or load with full training state (for resuming)
103
+ checkpoint = torch.load('pointnet2_cls_ssg_s123/checkpoints/resume.pth')
104
+ model_state = checkpoint['model_state']
105
+ optimizer_state = checkpoint['optimizer_state']
106
+ ```
107
+
108
+ ### Accessing Results
109
+
110
+ ```python
111
+ import json
112
+
113
+ # Load configuration
114
+ with open('pointnet2_cls_ssg_s123/config.json') as f:
115
+ config = json.load(f)
116
+
117
+ # Read metrics (each line is a JSON object)
118
+ with open('pointnet2_cls_ssg_s123/metrics.jsonl') as f:
119
+ for line in f:
120
+ epoch_metrics = json.loads(line)
121
+ print(epoch_metrics)
122
+ ```
123
+
124
+ ## Citation
125
+
126
+ If you use these models or results, please cite the original paper:
127
+
128
+ ```bibtex
129
+ @inproceedings{aizierjiang26benchmark,
130
+ title={Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification},
131
+ author={Aizierjiang Aiersilan},
132
+ booktitle={European Conference on Computer Vision},
133
+ organization={Springer},
134
+ year={2026}
135
+ }
136
+ ```
137
+
138
+ ## License
139
+
140
+ The models and code follow the project's original license. Please refer to the main repository for detailed license information.
141
+
142
+ ## Additional Resources
143
+
144
+ - **Project Website**: https://ezharjan.github.io/FLKD3DBenchmark/
145
+ - **Main Repository**: https://github.com/Ezharjan/FLKD3DBenchmark/
146
+ - **Paper**: Available at the project website
147
+
148
+ ## Notes
149
+
150
+ - All models were trained using PyTorch with CUDA acceleration
151
+ - Mixed precision (bf16) was applied where supported; exact fp32 on high performance GPUs
152
+ - Auto-resume checkpoints enable resuming interrupted training without loss of progress
153
+ - Metrics are reported as mean Β± std across multiple random seeds for robust statistical assessment
154
+
155
  ---
156
+
157
+ For questions, issues, or to contribute improvements, please visit the main repository or contact the authors through the project website.