README.md

---
title: SurgiTrack - Surgical Tool Tracking
emoji: 🔬
colorFrom: purple
colorTo: indigo
sdk: gradio
sdk_version: 4.44.0
app_file: app.py
pinned: false
license: mit
---

# SurgiTrack - Surgical Tool Tracking

Multi-class multi-tool tracking system for laparoscopic surgery videos.

## Overview

This demo implements the tracking pipeline from ["SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videos"](https://arxiv.org/abs/2312.07352), trained and evaluated on the CholecTrack20 dataset.

## Pipeline

1. **Detection**: YOLOv11x trained on 7 surgical tool classes
2. **Direction Estimation**: EfficientNet-B0 + Coordinate Attention predicts operator (MSLH, MSRH, ASRH)
3. **Tracking**: Operator-based slot assignment for graspers, fixed IDs for other tools

## Results

| Metric | Score |
|--------|-------|
| HOTA | 64.48% |
| AssA | 71.19% |
| DetA | 58.51% |

## Tool Classes

- Grasper (tracked by operator)
- Bipolar
- Hook
- Scissors
- Clipper
- Irrigator
- Specimen Bag

## Citation

```bibtex
@InProceedings{nwoye2023cholectrack20,
  author    = {Nwoye, Chinedu Innocent and Elgohary, Kareem and Srinivas, Anvita and Zaid, Fauzan and Lavanchy, Joël L. and Padoy, Nicolas},
  title     = {CholecTrack20: A Multi-Perspective Tracking Dataset for Surgical Tools},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  year      = {2025},
  month     = {June}
}
```

## Author

[Djalil Khelladi](https://github.com/akhellad)