Add out-of-sample results and arxiv link
Browse files
README.md
CHANGED
|
@@ -27,6 +27,7 @@ pipeline_tag: object-detection
|
|
| 27 |
- [Precision-Recall curve](https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/PR_curve.png) and [per class accuracy]((https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/confusion_matrix.png)) were evaluated at test time.
|
| 28 |
- mAP@0.5 = 0.33515
|
| 29 |
- Performance is quite variable depending on the target organism even when testing on in-distribution data.
|
|
|
|
| 30 |
|
| 31 |
## Training and Evaluation Data
|
| 32 |
- Training data is the [FathomNet2023 competition split](https://www.kaggle.com/competitions/fathomnet-out-of-sample-detection/overview) and internal MBARI data
|
|
|
|
| 27 |
- [Precision-Recall curve](https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/PR_curve.png) and [per class accuracy]((https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/confusion_matrix.png)) were evaluated at test time.
|
| 28 |
- mAP@0.5 = 0.33515
|
| 29 |
- Performance is quite variable depending on the target organism even when testing on in-distribution data.
|
| 30 |
+
- Identified out-of-sample images with a binary metric, returning [ROC ~= 0.7](https://arxiv.org/abs/2307.08781).
|
| 31 |
|
| 32 |
## Training and Evaluation Data
|
| 33 |
- Training data is the [FathomNet2023 competition split](https://www.kaggle.com/competitions/fathomnet-out-of-sample-detection/overview) and internal MBARI data
|