Update README with pipeline description
Browse files
README.md
CHANGED
|
@@ -1,13 +1,51 @@
|
|
| 1 |
---
|
|
|
|
| 2 |
license: mit
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
language: en
|
| 3 |
license: mit
|
| 4 |
+
tags: [3d-reconstruction, foot-scanning, 3dgs, colmap, sugar]
|
| 5 |
+
library_name: other
|
| 6 |
+
pipeline_tag: other
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# AMADEUS – 3D Foot Reconstruction Pipeline
|
| 10 |
+
|
| 11 |
+
AMADEUS (AI‑based Morphological Analysis & Design Engine for Unique Shoes) reconstructs a personalized 3D foot model from smartphone video and produces a ready-to-print shoe last. It combines YOLO11n-seg + SAM for segmentation, COLMAP for camera pose estimation, 3D Gaussian Splatting (3DGS) for point cloud optimisation, and SuGaR for mesh generation【528303309685221†L80-L94】.
|
| 12 |
+
|
| 13 |
+
## Pipeline
|
| 14 |
+
1. **Pre‑processing:** Segment the foot and scale marker from each frame and save masked images【717972134425363†screenshot】.
|
| 15 |
+
2. **3D Reconstruction:** Use COLMAP to build a sparse point cloud【894071447112061†screenshot】.
|
| 16 |
+
3. **Undistortion & Alignment:** Remove lens distortion and align the sparse model【894071447112061†screenshot】.
|
| 17 |
+
4. **3DGS Training:** Optimise a Gaussian point cloud to produce a dense representation【35837800387949†screenshot】.
|
| 18 |
+
5. **Meshing & Healing:** Convert the Gaussian field to a watertight mesh and remove noise【756719135168637†screenshot】.
|
| 19 |
+
6. **Scaling:** Convert to real-world dimensions using a checkerboard marker.
|
| 20 |
+
7. **3D Printing:** Slice and print the mesh.
|
| 21 |
+
8. **Troubleshooting:** Fix segmentation resolution mismatches and ensure adequate data【756719135168637†screenshot】.
|
| 22 |
+
|
| 23 |
+
## Installation and Usage
|
| 24 |
+
### Docker
|
| 25 |
+
```
|
| 26 |
+
docker build -t amadeus .
|
| 27 |
+
docker run --gpus all -it --rm \
|
| 28 |
+
-v $(pwd)/data:/app/data \
|
| 29 |
+
-v $(pwd)/output:/app/output \
|
| 30 |
+
amadeus
|
| 31 |
+
chmod +x run_pipeline.sh
|
| 32 |
+
xvfb-run -a ./run_pipeline.sh
|
| 33 |
+
```
|
| 34 |
+
|
| 35 |
+
### Manual Setup
|
| 36 |
+
Clone submodules (`gaussian-splatting` and `SuGaR`), install dependencies from `requirements.txt`, install COLMAP, and run the commands in `run_pipeline.sh` manually.
|
| 37 |
+
|
| 38 |
+
## Citation
|
| 39 |
+
If you use this project, please cite:
|
| 40 |
+
|
| 41 |
+
```
|
| 42 |
+
@report{amadeus2025,
|
| 43 |
+
title = {AI‑based Morphological Analysis & Design Engine for Unique Shoes},
|
| 44 |
+
author = {Kim Taeryang and Park Hyundong and Park Chanwoo and Bang Hojun},
|
| 45 |
+
year = {2025},
|
| 46 |
+
note = {P–Practical Project third semester (AI) team 3 report}
|
| 47 |
+
}
|
| 48 |
+
```
|
| 49 |
+
|
| 50 |
+
## License
|
| 51 |
+
MIT License.
|