SebasJanampa commited on
Commit
bb75be0
·
verified ·
1 Parent(s): d38f12a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -4
README.md CHANGED
@@ -3,9 +3,77 @@ license: apache-2.0
3
  tags:
4
  - model_hub_mixin
5
  - pytorch_model_hub_mixin
 
 
 
6
  ---
7
 
8
- This model has been pushed to the Hub using the [PytorchModelHubMixin](https://huggingface.co/docs/huggingface_hub/package_reference/mixins#huggingface_hub.PyTorchModelHubMixin) integration:
9
- - Code: [More Information Needed]
10
- - Paper: [More Information Needed]
11
- - Docs: [More Information Needed]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  tags:
4
  - model_hub_mixin
5
  - pytorch_model_hub_mixin
6
+ language:
7
+ - en
8
+ pipeline_tag: keypoint-detection
9
  ---
10
 
11
+ # DETRPose-M-COCO
12
+
13
+ DETRPose-M-COCO is a real-time object detection model introduced in the paper [DETRPose: Real-Time End-to-End Multi-Person Pose Estimation via Modified Transformer Decoder and Novel Denoising Keypoints](https://huggingface.co/papers/2506.13027).
14
+
15
+ - **Repository:** [https://github.com/SebastianJanampa/DETRPose](https://github.com/SebastianJanampa/DETRPose)
16
+ - **Paper:** [https://huggingface.co/papers/2506.13027](https://huggingface.co/papers/2506.13027)
17
+
18
+ ## 📝 Model Description
19
+ DETRPose introduces the first real-time end-to-end framework for multi-person pose estimation.
20
+ By leveraging the hybrid encoder from RT-DETR and the lightweight decoder architecture of D-FINE, DETRPose achieves low-latency inference without sacrificing accuracy.
21
+ The model introduces two primary methodological advancements:
22
+
23
+ * **Pose-LQE Layer:** A specialized head designed to improve confidence scores.
24
+ * **Advanced Training Paradigm:** Incorporates Denoising Keypoints and a custom Keypoint Similarity Varifocal loss function, ensuring robust learning and superior localization performance.
25
+
26
+
27
+ | Model | Dataset | AP | #Params | Latency | GFLOPs |
28
+ | :---: | :---: | :---: | :---: | :---: | :---: |
29
+ | **DETRPose-M** | COCO | 69.4 | 20.8 M | 7.01 ms | 67.3 |
30
+
31
+ ## 🚀 Installation
32
+
33
+ To use this model, you need to install the inference-ready branch of the DETRPose repository.
34
+ You can directly install the inference-ready branch using `pip`:
35
+ ```shell
36
+ pip install git+https://github.com/SebastianJanampa/DETRPose.git@inference_only
37
+ ````
38
+
39
+ ## 💻 Usage
40
+ This branch is designed to be easy to use for inference.
41
+ Here is a quick example of how to load a model and run it on a live webcam feed.
42
+ ```python
43
+ from detrpose import DETR
44
+
45
+ # Initialization
46
+ model = DETR(model='detrpose_hgnetv2_m')
47
+
48
+ # Inference
49
+ model(source=0) # inference on a webcam
50
+ ```
51
+
52
+
53
+ ## 📜 Citation
54
+ If you use `DETRPose` or its methods in your work, please cite the following BibTeX entries:
55
+
56
+ ```latex
57
+ @misc{janampa2025detrpose,
58
+ title={DETRPose: Real-time end-to-end transformer model for multi-person pose estimation},
59
+ author={Sebastian Janampa and Marios Pattichis},
60
+ year={2025},
61
+ eprint={2506.13027},
62
+ archivePrefix={arXiv},
63
+ primaryClass={cs.CV},
64
+ url={https://arxiv.org/abs/2506.13027},
65
+ }
66
+ ```
67
+
68
+ ## 🙏 Acknowledgement
69
+ This work was supported in part by [Lambda.ai](https://lambda.ai).
70
+
71
+ Our work is built upon [DEIM](https://github.com/Intellindust-AI-Lab/DEIM/tree/main), [D-FINE](https://github.com/Peterande/D-FINE), [Detectron2](https://github.com/facebookresearch/detectron2/tree/main), and [GroupPose](https://github.com/Michel-liu/GroupPose/tree/main).
72
+
73
+ ✨ Feel free to reach out if you have any questions! ✨
74
+
75
+ <div align="left">
76
+ <a href="https://lambda.ai" target="_blank">
77
+ <img src="./assets/lambda_logo2.png" width=500 >
78
+ </a>
79
+ </div>