Spaces:
Build error
Build error
update the readme
Browse files
README.md
CHANGED
|
@@ -105,6 +105,47 @@ The output is a dictionary containing the following metrics:
|
|
| 105 |
|
| 106 |
We levereage one of the internal variables of motmetrics ```MOTAccumulator``` class, ```events```, which keeps track of the detections hits and misses. These values are then processed via the ```track_ratios``` function which counts the ratio of assigned to total appearance count per unique object id. We then define the ```recognition``` function that counts how many objects have been seen more times then the desired threshold.
|
| 107 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 108 |
## Citations
|
| 109 |
|
| 110 |
```bibtex {"id":"01HPS3ASFJXVQR88985GKHAQRE"}
|
|
|
|
| 105 |
|
| 106 |
We levereage one of the internal variables of motmetrics ```MOTAccumulator``` class, ```events```, which keeps track of the detections hits and misses. These values are then processed via the ```track_ratios``` function which counts the ratio of assigned to total appearance count per unique object id. We then define the ```recognition``` function that counts how many objects have been seen more times then the desired threshold.
|
| 107 |
|
| 108 |
+
|
| 109 |
+
|
| 110 |
+
|
| 111 |
+
## W&B logging
|
| 112 |
+
When you use **module.wandb()**, it is possible to log the User Frindly metrics values in Weights and Bias (W&B). The W&B key is stored as a Secret in this repository.
|
| 113 |
+
|
| 114 |
+
### Params
|
| 115 |
+
- **wandb_project** - Name of the W&B project (Default: `'user_freindly_metrics'`)
|
| 116 |
+
- **log_plots** (bool, optional): Generates categorized bar charts for global metrics. Defaults to True
|
| 117 |
+
- **debug** (bool, optional): Logs everything to the console and w&b Logs page. Defaults to False
|
| 118 |
+
|
| 119 |
+
```python
|
| 120 |
+
import evaluate
|
| 121 |
+
import logging
|
| 122 |
+
from seametrics.payload.processor import PayloadProcessor
|
| 123 |
+
|
| 124 |
+
logging.basicConfig(level=logging.WARNING)
|
| 125 |
+
|
| 126 |
+
# Configure your dataset and model details
|
| 127 |
+
payload = PayloadProcessor(
|
| 128 |
+
dataset_name="SENTRY_VIDEOS_DATASET_QA",
|
| 129 |
+
gt_field="ground_truth_det_fused_id",
|
| 130 |
+
models=["ahoy_IR_b2_engine_3_7_0_757_g8765b007_oversea"],
|
| 131 |
+
sequence_list=["Sentry_2023_02_08_PROACT_CELADON_@6m_MOB_2023_02_08_14_41_51"],
|
| 132 |
+
tracking_mode=True
|
| 133 |
+
).payload
|
| 134 |
+
|
| 135 |
+
|
| 136 |
+
# Evaluate using SEA-AI/user-friendly-metrics
|
| 137 |
+
module = evaluate.load("SEA-AI/user-friendly-metrics")
|
| 138 |
+
res = module._compute(payload, max_iou=0.5, recognition_thresholds=[0.3, 0.5, 0.8])
|
| 139 |
+
|
| 140 |
+
module.wandb(res,log_plots=True, debug=True)
|
| 141 |
+
```
|
| 142 |
+
|
| 143 |
+
|
| 144 |
+
|
| 145 |
+

|
| 146 |
+
|
| 147 |
+

|
| 148 |
+
|
| 149 |
## Citations
|
| 150 |
|
| 151 |
```bibtex {"id":"01HPS3ASFJXVQR88985GKHAQRE"}
|