Init README
Browse files
README.md
CHANGED
|
@@ -1,3 +1,39 @@
|
|
| 1 |
---
|
| 2 |
license: cc-by-4.0
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: cc-by-4.0
|
| 3 |
+
tags:
|
| 4 |
+
- ocean
|
| 5 |
+
- benthic
|
| 6 |
+
- object-detection
|
| 7 |
---
|
| 8 |
+
|
| 9 |
+
# FathomNet2023 Baseline Model
|
| 10 |
+
|
| 11 |
+
## Model Details
|
| 12 |
+
- Trained by researchers at [Monterey Bay Aquarium Research Institute](https://www.mbari.org/) (MBARI) as a baseline for the [FathomNet2023 Competition](https://www.kaggle.com/competitions/fathomnet-out-of-sample-detection/overview) presented with the [Fine Grained Visual Categorization workshop](https://sites.google.com/view/fgvc10/home) at CVPR 2023.
|
| 13 |
+
- [Ultralytics YOLOv8.0.117](https://github.com/ultralytics/ultralytics/pull/3145)
|
| 14 |
+
- Object detection
|
| 15 |
+
- Fine tuned yolov8m to detect 290 fine grained taxonmic categories of benthic animals in the Greater Monterey Bay Area off the coast of Central California.
|
| 16 |
+
|
| 17 |
+
## Intended Use
|
| 18 |
+
- Make detections on images collect on the sea floor in the Monterey Bay Area.
|
| 19 |
+
|
| 20 |
+
## Factors
|
| 21 |
+
- Distribution shifts related to sampling platform, camera parameters, illumination, and deployment environment are expected to impact model performance.
|
| 22 |
+
- Evaluation was performed on an IID subset of available training data.
|
| 23 |
+
- Data to test out of distribution performance can be found on the [competition Kaggle page](https://www.kaggle.com/competitions/fathomnet-out-of-sample-detection/overview).
|
| 24 |
+
|
| 25 |
+
## Metrics
|
| 26 |
+
- [Precision-Recall curve](https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/PR_curve.png) and [per class accuracy]((https://huggingface.co/FathomNet/MBARI-midwater-supercategory-detector/blob/main/plots/confusion_matrix.png)) were evaluated at test time.
|
| 27 |
+
- mAP@0.5 = 0.33515
|
| 28 |
+
- Performance is quite variable depending on the target organism even when testing on in-distribution data.
|
| 29 |
+
|
| 30 |
+
## Training and Evaluation Data
|
| 31 |
+
- Training data is the [FathomNet2023 competition split](https://www.kaggle.com/competitions/fathomnet-out-of-sample-detection/overview) and internal MBARI data
|
| 32 |
+
- Class labels have a [long tail and localizations occur throughout the frame]().
|
| 33 |
+
|
| 34 |
+
## Deployment
|
| 35 |
+
In an environment running YOLOv8:
|
| 36 |
+
|
| 37 |
+
```
|
| 38 |
+
python classify/predict.py --weights best.pt --data data/images/
|
| 39 |
+
```
|