wdadawdada commited on
Commit
d993ecf
·
verified ·
1 Parent(s): 2012d8e

Update README with pipeline description

Browse files
Files changed (1) hide show
  1. README.md +49 -11
README.md CHANGED
@@ -1,13 +1,51 @@
1
  ---
 
2
  license: mit
3
- language:
4
- - en
5
- - ko
6
- metrics:
7
- - accuracy
8
- base_model:
9
- - facebook/sam3
10
- new_version: facebook/sam3
11
- pipeline_tag: image-segmentation, 3d-reconstruction, foot-scanning, 3dgs, colmap, sugar
12
- library_name: adapter-transformers
13
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language: en
3
  license: mit
4
+ tags: [3d-reconstruction, foot-scanning, 3dgs, colmap, sugar]
5
+ library_name: other
6
+ pipeline_tag: other
7
+ ---
8
+
9
+ # AMADEUS – 3D Foot Reconstruction Pipeline
10
+
11
+ AMADEUS (AI‑based Morphological Analysis & Design Engine for Unique Shoes) reconstructs a personalized 3D foot model from smartphone video and produces a ready-to-print shoe last. It combines YOLO11n-seg + SAM for segmentation, COLMAP for camera pose estimation, 3D Gaussian Splatting (3DGS) for point cloud optimisation, and SuGaR for mesh generation【528303309685221†L80-L94】.
12
+
13
+ ## Pipeline
14
+ 1. **Pre‑processing:** Segment the foot and scale marker from each frame and save masked images【717972134425363†screenshot】.
15
+ 2. **3D Reconstruction:** Use COLMAP to build a sparse point cloud【894071447112061†screenshot】.
16
+ 3. **Undistortion & Alignment:** Remove lens distortion and align the sparse model【894071447112061†screenshot】.
17
+ 4. **3DGS Training:** Optimise a Gaussian point cloud to produce a dense representation【35837800387949†screenshot】.
18
+ 5. **Meshing & Healing:** Convert the Gaussian field to a watertight mesh and remove noise【756719135168637†screenshot】.
19
+ 6. **Scaling:** Convert to real-world dimensions using a checkerboard marker.
20
+ 7. **3D Printing:** Slice and print the mesh.
21
+ 8. **Troubleshooting:** Fix segmentation resolution mismatches and ensure adequate data【756719135168637†screenshot】.
22
+
23
+ ## Installation and Usage
24
+ ### Docker
25
+ ```
26
+ docker build -t amadeus .
27
+ docker run --gpus all -it --rm \
28
+ -v $(pwd)/data:/app/data \
29
+ -v $(pwd)/output:/app/output \
30
+ amadeus
31
+ chmod +x run_pipeline.sh
32
+ xvfb-run -a ./run_pipeline.sh
33
+ ```
34
+
35
+ ### Manual Setup
36
+ Clone submodules (`gaussian-splatting` and `SuGaR`), install dependencies from `requirements.txt`, install COLMAP, and run the commands in `run_pipeline.sh` manually.
37
+
38
+ ## Citation
39
+ If you use this project, please cite:
40
+
41
+ ```
42
+ @report{amadeus2025,
43
+ title = {AI‑based Morphological Analysis & Design Engine for Unique Shoes},
44
+ author = {Kim Taeryang and Park Hyundong and Park Chanwoo and Bang Hojun},
45
+ year = {2025},
46
+ note = {P–Practical Project third semester (AI) team 3 report}
47
+ }
48
+ ```
49
+
50
+ ## License
51
+ MIT License.