Jesse Lopez commited on
Commit ·
e8fe9e1
1
Parent(s): ab1fb43
Update README.md
Browse filesAdd brief description of the training data.
README.md
CHANGED
|
@@ -3,19 +3,9 @@ tags:
|
|
| 3 |
- fastai
|
| 4 |
---
|
| 5 |
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
🥳 Congratulations on hosting your fastai model on the Hugging Face Hub!
|
| 9 |
-
|
| 10 |
-
# Some next steps
|
| 11 |
-
1. Fill out this model card with more information (see the template below and the [documentation here](https://huggingface.co/docs/hub/model-repos))!
|
| 12 |
-
|
| 13 |
-
2. Create a demo in Gradio or Streamlit using 🤗 Spaces ([documentation here](https://huggingface.co/docs/hub/spaces)).
|
| 14 |
-
|
| 15 |
-
3. Join the fastai community on the [Fastai Discord](https://discord.com/invite/YKrxeNn)!
|
| 16 |
-
|
| 17 |
-
Greetings fellow fastlearner 🤝! Don't forget to delete this content from your model card.
|
| 18 |
|
|
|
|
| 19 |
|
| 20 |
---
|
| 21 |
|
|
@@ -23,10 +13,60 @@ Greetings fellow fastlearner 🤝! Don't forget to delete this content from your
|
|
| 23 |
# Model card
|
| 24 |
|
| 25 |
## Model description
|
| 26 |
-
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
## Intended uses & limitations
|
| 29 |
-
|
|
|
|
|
|
|
| 30 |
|
| 31 |
## Training and evaluation data
|
| 32 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
- fastai
|
| 4 |
---
|
| 5 |
|
| 6 |
+
This model was trained to as part of collaboration between [Mote Marine Laboratory & Aquarium](https://mote.org), [Southeast Coastal Ocean Observing Regional Association](https://secoora.org), and [Axiom Data Science](https://axiomdatascience.com) to develop a model capable of detecting and classifying fish vocalizations from audio files collected from hydrophones.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
|
| 8 |
+
More information available at [the project archive repo](https://github.com/axiom-data-science/project-classify-fish-sounds).
|
| 9 |
|
| 10 |
---
|
| 11 |
|
|
|
|
| 13 |
# Model card
|
| 14 |
|
| 15 |
## Model description
|
| 16 |
+
|
| 17 |
+
This model was trained on spectrograms
|
| 18 |
+
|
| 19 |
+
A [reproducible Jupyter notebook](https://github.com/axiom-data-science/project-classify-fish-sounds/blob/main/notebooks/train-resnet101-fastai.ipynb) describing the training of the model is available in the archive repo.
|
| 20 |
|
| 21 |
## Intended uses & limitations
|
| 22 |
+
|
| 23 |
+
The model was intended to be a proof on concept to aid researchers identify fish vocalizations through vast amounts of audio data collected from hydrophones.
|
| 24 |
+
Although the training data was collected using multiple devices in multiple locations, the model may not be generally applicable to other uses.
|
| 25 |
|
| 26 |
## Training and evaluation data
|
| 27 |
+
|
| 28 |
+
A training set of spectrograms of fish calls was created based on annotations of fish sounds in passive acoustic recordings by a hydrophone were provided by Jim Locascio, Max Fullmer, and volunteers from the [Mote Marine Laboratory & Aquarium](https://mote.org).
|
| 29 |
+
|
| 30 |
+
Due to severe imbalances in the number of samples per class, the training involved both under-sampling classes with many samples and over-sampling classes with few classes so that the model was trained on 50 samples per class. This number was derived in a completely ad-hoc fashion based on the distribution of class samples.
|
| 31 |
+
|
| 32 |
+
### Class label description
|
| 33 |
+
|
| 34 |
+
| Call Index | Description |
|
| 35 |
+
|------------|-------------|
|
| 36 |
+
| 0 | Background noise (no fish vocalizations) |
|
| 37 |
+
| 1 | Black grouper 1 |
|
| 38 |
+
| 2 | Black grouper 2 |
|
| 39 |
+
| 3 | Black grouper grunt |
|
| 40 |
+
| 4 | Black grouper spawning rush |
|
| 41 |
+
| 5 | Black grouper chorus < 50% of file |
|
| 42 |
+
| 6 | Black grouper chrous > 50% of file |
|
| 43 |
+
| 8 | Unidentified sound type |
|
| 44 |
+
| 9 | Red grouper 1 |
|
| 45 |
+
| 10 | Red grouper 2 |
|
| 46 |
+
| 17 | Red hind 1 |
|
| 47 |
+
| 18 | Red hind 2 |
|
| 48 |
+
| 19 | Red hind 3 |
|
| 49 |
+
| 25 | Goliath grouper 1 |
|
| 50 |
+
| 27 | Multi-phase goliath grouper |
|
| 51 |
+
| 28 | Sea trout chorus |
|
| 52 |
+
| 29 | Silver perch call |
|
| 53 |
+
|
| 54 |
+
### Class indices in trained model
|
| 55 |
+
|
| 56 |
+
Some classes did not meet the training criteria, high signal-to-noise ratio and minimum call overlap, and were therefore excluded from the model training.
|
| 57 |
+
As such, the number of classes represented in the trained model is few than the amount of labeled classes in the training set.
|
| 58 |
+
|
| 59 |
+
| Call Index | Description |
|
| 60 |
+
----------------------------
|
| 61 |
+
|0 | No call |
|
| 62 |
+
|1 | Black grouper call |
|
| 63 |
+
|2 | Black grouper call 2 |
|
| 64 |
+
|3 | Black grouper grunt |
|
| 65 |
+
|4 | Unidentified sound |
|
| 66 |
+
|5 | Red grouper 1 |
|
| 67 |
+
|6 | Red grouper 2 |
|
| 68 |
+
|7 | Red hind 1 |
|
| 69 |
+
|8 | Red hind 2 |
|
| 70 |
+
|9 | Red hind 3 |
|
| 71 |
+
|10 | Goliath grouper |
|
| 72 |
+
|11 | Goliath grouper multi-phase |
|