Upload from Ropedia Academy
Browse files- README.md +44 -3
- figure.png +0 -0
- metrics.json +11 -11
- pose.pt +1 -1
README.md
CHANGED
|
@@ -1,13 +1,54 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
| 3 |
tags:
|
| 4 |
- ropedia-academy
|
| 5 |
- educational
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
-
#
|
| 9 |
|
| 10 |
-
|
| 11 |
|
|
|
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
library_name: pytorch
|
| 4 |
tags:
|
| 5 |
- ropedia-academy
|
| 6 |
- educational
|
| 7 |
+
- keypoint-detection
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# 2D pose estimation (heatmap regression)
|
| 11 |
|
| 12 |
+
A fully-convolutional net that predicts per-joint heatmaps, decoded to coordinates by soft-argmax. Best-checkpoint by PCK.
|
| 13 |
|
| 14 |
+
Trained from scratch in **[Ropedia Academy](https://chaoyue0307.github.io/ropedia-academy/)** — an interactive, bilingual course on embodied & spatial AI. **Educational model:** small and quick to train; the value is the *method* and a reproducible pipeline, not a leaderboard score.
|
| 15 |
|
| 16 |
+
| | |
|
| 17 |
+
|---|---|
|
| 18 |
+
| **Task** | 2D keypoint detection |
|
| 19 |
+
| **Data** | synthetic articulated arm |
|
| 20 |
+
| **Track** | A · Human modeling |
|
| 21 |
+
| **Notebook** | [](https://colab.research.google.com/github/ChaoYue0307/ropedia-academy/blob/main/notebooks/training/A_pose_heatmap.ipynb) |
|
| 22 |
+
|
| 23 |
+
## Results
|
| 24 |
+
|
| 25 |
+
| metric | value |
|
| 26 |
+
|---|---|
|
| 27 |
+
| pck (final) | 0.396 |
|
| 28 |
+
|
| 29 |
+
|
| 30 |
+

|
| 31 |
+
|
| 32 |
+
## How to use
|
| 33 |
+
|
| 34 |
+
```python
|
| 35 |
+
import torch
|
| 36 |
+
state = torch.load("model.pt", map_location="cpu") # some labs save pose.pt / gaussians.pt / transform.pt
|
| 37 |
+
# Rebuild the model class from the Ropedia Academy notebook (linked above), then:
|
| 38 |
+
# model.load_state_dict(state)
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
## Files
|
| 42 |
+
|
| 43 |
+
- `figure.png`
|
| 44 |
+
- `metrics.json`
|
| 45 |
+
- `pose.pt`
|
| 46 |
+
|
| 47 |
+
|
| 48 |
+
## Reproduce / train your own
|
| 49 |
+
|
| 50 |
+
Open the [lab notebook in Colab](https://colab.research.google.com/github/ChaoYue0307/ropedia-academy/blob/main/notebooks/training/A_pose_heatmap.ipynb) → **Runtime → GPU → Run all**, then its *Publish to the Hugging Face Hub* cell. Browse every lab in the [Ropedia Academy Labs tab](https://chaoyue0307.github.io/ropedia-academy/labs).
|
| 51 |
+
|
| 52 |
+
|
| 53 |
+
---
|
| 54 |
+
*Part of the [Ropedia Academy](https://chaoyue0307.github.io/ropedia-academy/) trained-model collection.*
|
figure.png
CHANGED
|
|
metrics.json
CHANGED
|
@@ -2,47 +2,47 @@
|
|
| 2 |
"pck": [
|
| 3 |
[
|
| 4 |
0,
|
| 5 |
-
0.
|
| 6 |
],
|
| 7 |
[
|
| 8 |
100,
|
| 9 |
-
0.
|
| 10 |
],
|
| 11 |
[
|
| 12 |
200,
|
| 13 |
-
0.
|
| 14 |
],
|
| 15 |
[
|
| 16 |
300,
|
| 17 |
-
0.
|
| 18 |
],
|
| 19 |
[
|
| 20 |
400,
|
| 21 |
-
0.
|
| 22 |
],
|
| 23 |
[
|
| 24 |
500,
|
| 25 |
-
0.
|
| 26 |
],
|
| 27 |
[
|
| 28 |
600,
|
| 29 |
-
0.
|
| 30 |
],
|
| 31 |
[
|
| 32 |
700,
|
| 33 |
-
0.
|
| 34 |
],
|
| 35 |
[
|
| 36 |
800,
|
| 37 |
-
0.
|
| 38 |
],
|
| 39 |
[
|
| 40 |
900,
|
| 41 |
-
0.
|
| 42 |
],
|
| 43 |
[
|
| 44 |
1000,
|
| 45 |
-
0.
|
| 46 |
]
|
| 47 |
]
|
| 48 |
}
|
|
|
|
| 2 |
"pck": [
|
| 3 |
[
|
| 4 |
0,
|
| 5 |
+
0.349
|
| 6 |
],
|
| 7 |
[
|
| 8 |
100,
|
| 9 |
+
0.328
|
| 10 |
],
|
| 11 |
[
|
| 12 |
200,
|
| 13 |
+
0.365
|
| 14 |
],
|
| 15 |
[
|
| 16 |
300,
|
| 17 |
+
0.406
|
| 18 |
],
|
| 19 |
[
|
| 20 |
400,
|
| 21 |
+
0.391
|
| 22 |
],
|
| 23 |
[
|
| 24 |
500,
|
| 25 |
+
0.391
|
| 26 |
],
|
| 27 |
[
|
| 28 |
600,
|
| 29 |
+
0.411
|
| 30 |
],
|
| 31 |
[
|
| 32 |
700,
|
| 33 |
+
0.401
|
| 34 |
],
|
| 35 |
[
|
| 36 |
800,
|
| 37 |
+
0.406
|
| 38 |
],
|
| 39 |
[
|
| 40 |
900,
|
| 41 |
+
0.375
|
| 42 |
],
|
| 43 |
[
|
| 44 |
1000,
|
| 45 |
+
0.396
|
| 46 |
]
|
| 47 |
]
|
| 48 |
}
|
pose.pt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 122339
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1bb8ac0d292cba19d91258ab1097db2109ff4aeffd7efa86d796d32eb901d9ff
|
| 3 |
size 122339
|