korallll commited on
Commit
b464fdc
·
verified ·
1 Parent(s): 0929701

Add InTheWild result.yaml + README badge/row (all 5 core datasets)

Browse files
.eval_results/SpeechAntiSpoofingBenchmarks/InTheWild/result.yaml ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Res2TCNGuard
4
+ slug: res2tcnguard
5
+ paper:
6
+ arxiv_id: 10.48084/etasr.8906
7
+ dataset:
8
+ id: SpeechAntiSpoofingBenchmarks/InTheWild
9
+ revision: a957f2582802cdb5964e118818c2e46b3d61aa35
10
+ split: test
11
+ scores:
12
+ eer_percent: 52.52200406228842
13
+ n_trials: 31779
14
+ n_skipped: 0
15
+ arena:
16
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
17
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard
18
+ artifact:
19
+ scores_url: https://huggingface.co/SpeechAntiSpoofingBenchmarks/Res2TCNGuard/resolve/09297018a6b118ece4764d23b5a23e2bfc28621e/.eval_results/SpeechAntiSpoofingBenchmarks/InTheWild/scores.txt
README.md CHANGED
@@ -14,6 +14,7 @@ tags:
14
  [![EER% 17.02 on ASVspoof2021_DF](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__DF-17.02%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
15
  [![EER% 13.67 on ASVspoof2021_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__LA-13.67%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
16
  [![EER% 56.10 on CD-ADD](https://img.shields.io/badge/EER%25%20on%20CD--ADD-56.10%25-red)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
 
17
  [![arena tier](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/tier.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
18
  [![arena rank](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/rank.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
19
 
@@ -73,6 +74,7 @@ crop), so the numbers are exactly reproducible from the pinned score file.
73
  | ASVspoof2021_DF | test | **17.02** | 611,829 | 0 | cross-dataset generalization |
74
  | ASVspoof2021_LA | test | **13.67** | 181,566 | 0 | cross-dataset generalization |
75
  | CD-ADD | test | **56.10** | 20,786 | 0 | out-of-domain (modern neural-TTS); does not generalize |
 
76
 
77
  The ASVspoof2019_LA result reproduces the paper's reported 1.49 % on the LA eval set.
78
  ASVspoof2021_DF is an out-of-domain test (the model was trained only on ASVspoof2019 LA),
 
14
  [![EER% 17.02 on ASVspoof2021_DF](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__DF-17.02%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
15
  [![EER% 13.67 on ASVspoof2021_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__LA-13.67%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
16
  [![EER% 56.10 on CD-ADD](https://img.shields.io/badge/EER%25%20on%20CD--ADD-56.10%25-red)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
17
+ [![EER% 52.52 on InTheWild](https://img.shields.io/badge/EER%25%20on%20InTheWild-52.52%25-red)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
18
  [![arena tier](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/tier.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
19
  [![arena rank](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/rank.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
20
 
 
74
  | ASVspoof2021_DF | test | **17.02** | 611,829 | 0 | cross-dataset generalization |
75
  | ASVspoof2021_LA | test | **13.67** | 181,566 | 0 | cross-dataset generalization |
76
  | CD-ADD | test | **56.10** | 20,786 | 0 | out-of-domain (modern neural-TTS); does not generalize |
77
+ | InTheWild | test | **52.52** | 31,779 | 0 | out-of-domain (real-world deepfakes); does not generalize |
78
 
79
  The ASVspoof2019_LA result reproduces the paper's reported 1.49 % on the LA eval set.
80
  ASVspoof2021_DF is an out-of-domain test (the model was trained only on ASVspoof2019 LA),