Update README.md
Browse files
README.md
CHANGED
|
@@ -3,9 +3,77 @@ license: apache-2.0
|
|
| 3 |
tags:
|
| 4 |
- model_hub_mixin
|
| 5 |
- pytorch_model_hub_mixin
|
|
|
|
|
|
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
-
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
tags:
|
| 4 |
- model_hub_mixin
|
| 5 |
- pytorch_model_hub_mixin
|
| 6 |
+
language:
|
| 7 |
+
- en
|
| 8 |
+
pipeline_tag: keypoint-detection
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# DETRPose-M-COCO
|
| 12 |
+
|
| 13 |
+
DETRPose-M-COCO is a real-time object detection model introduced in the paper [DETRPose: Real-Time End-to-End Multi-Person Pose Estimation via Modified Transformer Decoder and Novel Denoising Keypoints](https://huggingface.co/papers/2506.13027).
|
| 14 |
+
|
| 15 |
+
- **Repository:** [https://github.com/SebastianJanampa/DETRPose](https://github.com/SebastianJanampa/DETRPose)
|
| 16 |
+
- **Paper:** [https://huggingface.co/papers/2506.13027](https://huggingface.co/papers/2506.13027)
|
| 17 |
+
|
| 18 |
+
## 📝 Model Description
|
| 19 |
+
DETRPose introduces the first real-time end-to-end framework for multi-person pose estimation.
|
| 20 |
+
By leveraging the hybrid encoder from RT-DETR and the lightweight decoder architecture of D-FINE, DETRPose achieves low-latency inference without sacrificing accuracy.
|
| 21 |
+
The model introduces two primary methodological advancements:
|
| 22 |
+
|
| 23 |
+
* **Pose-LQE Layer:** A specialized head designed to improve confidence scores.
|
| 24 |
+
* **Advanced Training Paradigm:** Incorporates Denoising Keypoints and a custom Keypoint Similarity Varifocal loss function, ensuring robust learning and superior localization performance.
|
| 25 |
+
|
| 26 |
+
|
| 27 |
+
| Model | Dataset | AP | #Params | Latency | GFLOPs |
|
| 28 |
+
| :---: | :---: | :---: | :---: | :---: | :---: |
|
| 29 |
+
| **DETRPose-M** | COCO | 69.4 | 20.8 M | 7.01 ms | 67.3 |
|
| 30 |
+
|
| 31 |
+
## 🚀 Installation
|
| 32 |
+
|
| 33 |
+
To use this model, you need to install the inference-ready branch of the DETRPose repository.
|
| 34 |
+
You can directly install the inference-ready branch using `pip`:
|
| 35 |
+
```shell
|
| 36 |
+
pip install git+https://github.com/SebastianJanampa/DETRPose.git@inference_only
|
| 37 |
+
````
|
| 38 |
+
|
| 39 |
+
## 💻 Usage
|
| 40 |
+
This branch is designed to be easy to use for inference.
|
| 41 |
+
Here is a quick example of how to load a model and run it on a live webcam feed.
|
| 42 |
+
```python
|
| 43 |
+
from detrpose import DETR
|
| 44 |
+
|
| 45 |
+
# Initialization
|
| 46 |
+
model = DETR(model='detrpose_hgnetv2_m')
|
| 47 |
+
|
| 48 |
+
# Inference
|
| 49 |
+
model(source=0) # inference on a webcam
|
| 50 |
+
```
|
| 51 |
+
|
| 52 |
+
|
| 53 |
+
## 📜 Citation
|
| 54 |
+
If you use `DETRPose` or its methods in your work, please cite the following BibTeX entries:
|
| 55 |
+
|
| 56 |
+
```latex
|
| 57 |
+
@misc{janampa2025detrpose,
|
| 58 |
+
title={DETRPose: Real-time end-to-end transformer model for multi-person pose estimation},
|
| 59 |
+
author={Sebastian Janampa and Marios Pattichis},
|
| 60 |
+
year={2025},
|
| 61 |
+
eprint={2506.13027},
|
| 62 |
+
archivePrefix={arXiv},
|
| 63 |
+
primaryClass={cs.CV},
|
| 64 |
+
url={https://arxiv.org/abs/2506.13027},
|
| 65 |
+
}
|
| 66 |
+
```
|
| 67 |
+
|
| 68 |
+
## 🙏 Acknowledgement
|
| 69 |
+
This work was supported in part by [Lambda.ai](https://lambda.ai).
|
| 70 |
+
|
| 71 |
+
Our work is built upon [DEIM](https://github.com/Intellindust-AI-Lab/DEIM/tree/main), [D-FINE](https://github.com/Peterande/D-FINE), [Detectron2](https://github.com/facebookresearch/detectron2/tree/main), and [GroupPose](https://github.com/Michel-liu/GroupPose/tree/main).
|
| 72 |
+
|
| 73 |
+
✨ Feel free to reach out if you have any questions! ✨
|
| 74 |
+
|
| 75 |
+
<div align="left">
|
| 76 |
+
<a href="https://lambda.ai" target="_blank">
|
| 77 |
+
<img src="./assets/lambda_logo2.png" width=500 >
|
| 78 |
+
</a>
|
| 79 |
+
</div>
|