Update README.md
Browse files
README.md
CHANGED
|
@@ -96,29 +96,29 @@ with torch.no_grad():
|
|
| 96 |
## Model Performance Comparison
|
| 97 |
The following table presents the classification accuracy of various models on one-shot and five-shot bird sound classification tasks, evaluated across different [soundscape datasets](https://zenodo.org/records/13994373).
|
| 98 |
|
| 99 |
-
| Model |
|
| 100 |
-
|---------------------------|------------|-------------|-------------|-------------|-------------|-------------|-------------|-------|
|
| 101 |
-
| Random Guessing |
|
| 102 |
-
| |
|
| 103 |
-
| **1-Shot Classification** |
|
| 104 |
-
| BirdAVES-biox-base |
|
| 105 |
-
| BirdAVES-bioxn-large |
|
| 106 |
-
| BioLingual |
|
| 107 |
-
| Perch |
|
| 108 |
-
| CE (Ours) |
|
| 109 |
-
| SimCLR (Ours) |
|
| 110 |
-
| SupCon (Ours) |
|
| 111 |
-
| ProtoCLR (Ours) |
|
| 112 |
-
| |
|
| 113 |
-
| **5-Shot Classification** |
|
| 114 |
-
| BirdAVES-biox-base |
|
| 115 |
-
| BirdAVES-bioxn-large |
|
| 116 |
-
| BioLingual |
|
| 117 |
-
| Perch |
|
| 118 |
-
| CE (Ours) |
|
| 119 |
-
| SimCLR (Ours) |
|
| 120 |
-
| SupCon (Ours) |
|
| 121 |
-
| ProtoCLR (Ours) |
|
| 122 |
|
| 123 |
For additional details, please see the [pre-print on arXiv](https://arxiv.org/abs/2409.08589) and the [official GitHub repository](https://github.com/ilyassmoummad/ProtoCLR).
|
| 124 |
|
|
|
|
| 96 |
## Model Performance Comparison
|
| 97 |
The following table presents the classification accuracy of various models on one-shot and five-shot bird sound classification tasks, evaluated across different [soundscape datasets](https://zenodo.org/records/13994373).
|
| 98 |
|
| 99 |
+
| Model | Training Params (M) | PER | NES | UHH | HSN | SSW | SNE | Mean |
|
| 100 |
+
|---------------------------|---------------------|-------------|-------------|-------------|-------------|-------------|-------------|-------|
|
| 101 |
+
| Random Guessing | - | 0.75 | 1.12 | 3.70 | 5.26 | 1.04 | 1.78 | 2.22 |
|
| 102 |
+
| | | | | | | | | |
|
| 103 |
+
| **1-Shot Classification** | | | | | | | | |
|
| 104 |
+
| BirdAVES-biox-base | 95 | 7.41±1.0 | 26.4±2.3 | 13.2±3.1 | 9.84±3.5 | 8.74±0.6 | 14.1±3.1 | 13.2 |
|
| 105 |
+
| BirdAVES-bioxn-large | 316 | 7.59±0.8 | 27.2±3.6 | 13.7±2.9 | 12.5±3.6 | 10.0±1.4 | 14.5±3.2 | 14.2 |
|
| 106 |
+
| BioLingual | 153 | 6.21±1.1 | 37.5±2.9 | 17.8±3.5 | 17.6±5.1 | 22.5±4.0 | 26.4±3.4 | 21.3 |
|
| 107 |
+
| Perch | 80 | 9.10±5.3 | 42.4±4.9 | 19.8±5.0 | 26.7±9.8 | 22.3±3.3 | 29.1±5.9 | 24.9 |
|
| 108 |
+
| CE (Ours) | 23 | 9.55±1.5 | 41.3±3.6 | 19.7±4.7 | 25.2±5.7 | 17.8±1.4 | 31.5±5.4 | 24.2 |
|
| 109 |
+
| SimCLR (Ours) | 19 | 7.85±1.1 | 31.2±2.4 | 14.9±2.9 | 19.0±3.8 | 10.6±1.1 | 24.0±4.1 | 17.9 |
|
| 110 |
+
| SupCon (Ours) | 19 | 8.53±1.1 | 39.8±6.0 | 18.8±3.0 | 20.4±6.9 | 12.6±1.6 | 23.2±3.1 | 20.5 |
|
| 111 |
+
| ProtoCLR (Ours) | 19 | 9.23±1.6 | 38.6±5.1 | 18.4±2.3 | 21.2±7.3 | 15.5±2.3 | 25.8±5.2 | 21.4 |
|
| 112 |
+
| | | | | | | | | |
|
| 113 |
+
| **5-Shot Classification** | | | | | | | | |
|
| 114 |
+
| BirdAVES-biox-base | 95 | 11.6±0.8 | 39.7±1.8 | 22.5±2.4 | 22.1±3.3 | 16.1±1.7 | 28.3±2.3 | 23.3 |
|
| 115 |
+
| BirdAVES-bioxn-large | 316 | 15.0±0.9 | 42.6±2.7 | 23.7±3.8 | 28.4±2.4 | 18.3±1.8 | 27.3±2.3 | 25.8 |
|
| 116 |
+
| BioLingual | 153 | 13.6±1.3 | 65.2±1.4 | 31.0±2.9 | 34.3±3.5 | 43.9±0.9 | 49.9±2.3 | 39.6 |
|
| 117 |
+
| Perch | 80 | 21.2±1.2 | 71.7±1.5 | 39.5±3.0 | 52.5±5.9 | 48.0±1.9 | 59.7±1.8 | 48.7 |
|
| 118 |
+
| CE (Ours) | 23 | 21.4±1.3 | 69.2±1.8 | 35.6±3.4 | 48.2±5.5 | 39.9±1.1 | 57.5±2.3 | 45.3 |
|
| 119 |
+
| SimCLR (Ours) | 19 | 15.4±1.0 | 54.0±1.8 | 23.0±2.3 | 32.8±4.0 | 22.0±1.2 | 40.7±2.4 | 31.3 |
|
| 120 |
+
| SupCon (Ours) | 19 | 17.2±1.3 | 64.6±2.4 | 34.1±2.9 | 42.5±2.9 | 30.8±0.8 | 48.1±2.4 | 39.5 |
|
| 121 |
+
| ProtoCLR (Ours) | 19 | 19.2±1.1 | 67.9±2.8 | 36.1±4.3 | 48.0±4.3 | 34.6±2.3 | 48.6±2.8 | 42.4 |
|
| 122 |
|
| 123 |
For additional details, please see the [pre-print on arXiv](https://arxiv.org/abs/2409.08589) and the [official GitHub repository](https://github.com/ilyassmoummad/ProtoCLR).
|
| 124 |
|