d-semantic-mapping / README.md
cy0307's picture
Upload from Ropedia Academy
f4f568d verified
|
Raw
History Blame Contribute Delete
4.61 kB
---
license: mit
library_name: pytorch
tags:
- ropedia-academy
- educational
- embodied-ai
- from-scratch
- reproducible
- mapping
---
# Bayesian semantic mapping
> Fuses noisy observations into an occupancy (log-odds) + semantic-label map that converges to ground truth.
Trained from scratch in **[Ropedia Academy](https://chaoyue0307.github.io/ropedia-academy/)** β€” an interactive, bilingual course on embodied & spatial AI. **Educational model:** small and quick to train; the value is the *method* and a reproducible pipeline, not a leaderboard score. Try it live in the **[Ropedia demos Space](https://huggingface.co/spaces/cy0307/ropedia-demos)**.
## At a glance
| | |
|---|---|
| **Base model** | Trained **from scratch** (random initialization) β€” no pretrained base model. |
| **Task** | occupancy + semantic mapping |
| **Training objective** | **Bayesian** log-odds occupancy + per-cell semantic-label counting (no gradient training). |
| **Track** | D Β· Scene & world models |
| **Notebook** | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ChaoYue0307/ropedia-academy/blob/main/notebooks/training/D_semantic_mapping.ipynb) |
## Dataset
- **Name:** 2D grid world
- **Type:** synthetic β€” procedural
- **Size / stats:** 32Γ—32 cells, 4 semantic classes; ~60 noisy observations/step (p_occ=0.8, p_label=0.7)
- **Split:** single map
- **Source:** procedural
## Training config
No gradient training β€” Bayesian log-odds occupancy + label counting over ~300 observation rounds.
## Evaluation results
| metric | value | meaning |
|---|---|---|
| `history (final)` | 1.0 | |
![figure](figure.png)
## Inference example
```python
import torch
state = torch.load("labels.npy", map_location="cpu") # this repo's checkpoint
# Rebuild the exact module from the lab notebook (see "Reproduce"), then:
# model.load_state_dict(state); model.eval()
```
## Limitations
**Educational scale.** Trained quickly on CPU on small or synthetic data, so absolute numbers are not competitive with production systems β€” the value is the *method* and a reproducible pipeline. No large-scale data, no hyperparameter sweep, and no multi-seed variance is reported. **Not for production use.**
## Failure cases
Mis-set sensor probabilities make the map over/under-confident; dynamic objects smear across cells.
## Reproduce / train your own
**One click:** open the notebook in Colab β†’ **Runtime β†’ GPU β†’ Run all**, then run its *Publish to the Hugging Face Hub* cell.
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ChaoYue0307/ropedia-academy/blob/main/notebooks/training/D_semantic_mapping.ipynb)
**From a shell:**
```bash
git clone https://github.com/ChaoYue0307/ropedia-academy.git && cd ropedia-academy
pip install torch numpy matplotlib scikit-learn scikit-image gymnasium
jupyter nbconvert --to notebook --execute notebooks/training/D_semantic_mapping.ipynb --output run.ipynb
# optional: override training length, e.g. STEPS=2000 (or EPISODES=600) before running
```
## Files
- `figure.png`
- `labels.npy`
- `metrics.json`
- `occ.npy`
## License
Code & weights: **MIT** (this repository) β€” educational use encouraged.
Data: generated procedurally in the notebook β€” no external dataset.
## Citation
If you use this model or the course materials, please cite:
```bibtex
@misc{ropedia_academy,
title = {Ropedia Academy: an interactive course on embodied & spatial AI},
author = {Ropedia Academy},
year = {2026},
howpublished = {\url{https://chaoyue0307.github.io/ropedia-academy/}}
}
```
**Method / original work:** Moravec & Elfes, *High-Resolution Maps from Wide-Angle Sonar (occupancy grids)*, 1985; McCormac et al., *SemanticFusion*, ICRA 2017.
## Related assets
- πŸš€ **Live demos:** [https://huggingface.co/spaces/cy0307/ropedia-demos](https://huggingface.co/spaces/cy0307/ropedia-demos)
- πŸ€— **All trained models + collection:** [https://huggingface.co/cy0307](https://huggingface.co/cy0307)
- πŸ“š **Course & all labs:** [https://chaoyue0307.github.io/ropedia-academy/](https://chaoyue0307.github.io/ropedia-academy/) Β· [Labs tab](https://chaoyue0307.github.io/ropedia-academy/labs)
- πŸ’» **Source / notebooks:** [github.com/ChaoYue0307/ropedia-academy](https://github.com/ChaoYue0307/ropedia-academy)
---
*Part of the [Ropedia Academy](https://chaoyue0307.github.io/ropedia-academy/) trained-model collection. Contributions & issues welcome on [GitHub](https://github.com/ChaoYue0307/ropedia-academy).*