Add InTheWild result.yaml + README badge/row (all 5 core datasets)
Browse files
.eval_results/SpeechAntiSpoofingBenchmarks/InTheWild/result.yaml
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
schema_version: 1
|
| 2 |
+
system:
|
| 3 |
+
name: Res2TCNGuard
|
| 4 |
+
slug: res2tcnguard
|
| 5 |
+
paper:
|
| 6 |
+
arxiv_id: 10.48084/etasr.8906
|
| 7 |
+
dataset:
|
| 8 |
+
id: SpeechAntiSpoofingBenchmarks/InTheWild
|
| 9 |
+
revision: a957f2582802cdb5964e118818c2e46b3d61aa35
|
| 10 |
+
split: test
|
| 11 |
+
scores:
|
| 12 |
+
eer_percent: 52.52200406228842
|
| 13 |
+
n_trials: 31779
|
| 14 |
+
n_skipped: 0
|
| 15 |
+
arena:
|
| 16 |
+
url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
|
| 17 |
+
system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard
|
| 18 |
+
artifact:
|
| 19 |
+
scores_url: https://huggingface.co/SpeechAntiSpoofingBenchmarks/Res2TCNGuard/resolve/09297018a6b118ece4764d23b5a23e2bfc28621e/.eval_results/SpeechAntiSpoofingBenchmarks/InTheWild/scores.txt
|
README.md
CHANGED
|
@@ -14,6 +14,7 @@ tags:
|
|
| 14 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 15 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 16 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
|
|
|
| 17 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 18 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 19 |
|
|
@@ -73,6 +74,7 @@ crop), so the numbers are exactly reproducible from the pinned score file.
|
|
| 73 |
| ASVspoof2021_DF | test | **17.02** | 611,829 | 0 | cross-dataset generalization |
|
| 74 |
| ASVspoof2021_LA | test | **13.67** | 181,566 | 0 | cross-dataset generalization |
|
| 75 |
| CD-ADD | test | **56.10** | 20,786 | 0 | out-of-domain (modern neural-TTS); does not generalize |
|
|
|
|
| 76 |
|
| 77 |
The ASVspoof2019_LA result reproduces the paper's reported 1.49 % on the LA eval set.
|
| 78 |
ASVspoof2021_DF is an out-of-domain test (the model was trained only on ASVspoof2019 LA),
|
|
|
|
| 14 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 15 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 16 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 17 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 18 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 19 |
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
|
| 20 |
|
|
|
|
| 74 |
| ASVspoof2021_DF | test | **17.02** | 611,829 | 0 | cross-dataset generalization |
|
| 75 |
| ASVspoof2021_LA | test | **13.67** | 181,566 | 0 | cross-dataset generalization |
|
| 76 |
| CD-ADD | test | **56.10** | 20,786 | 0 | out-of-domain (modern neural-TTS); does not generalize |
|
| 77 |
+
| InTheWild | test | **52.52** | 31,779 | 0 | out-of-domain (real-world deepfakes); does not generalize |
|
| 78 |
|
| 79 |
The ASVspoof2019_LA result reproduces the paper's reported 1.49 % on the LA eval set.
|
| 80 |
ASVspoof2021_DF is an out-of-domain test (the model was trained only on ASVspoof2019 LA),
|