korallll commited on
Commit
c4370b0
·
verified ·
1 Parent(s): 44f5a83

Add CD-ADD result.yaml + README badge/row

Browse files
.eval_results/SpeechAntiSpoofingBenchmarks/CD-ADD/result.yaml ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Res2TCNGuard
4
+ slug: res2tcnguard
5
+ paper:
6
+ arxiv_id: 10.48084/etasr.8906
7
+ dataset:
8
+ id: SpeechAntiSpoofingBenchmarks/CD-ADD
9
+ revision: c2de87d49b268b624e6af7440dc2890703098965
10
+ split: test
11
+ scores:
12
+ eer_percent: 56.0992700729927
13
+ n_trials: 20786
14
+ n_skipped: 0
15
+ arena:
16
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
17
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard
18
+ artifact:
19
+ scores_url: https://huggingface.co/SpeechAntiSpoofingBenchmarks/Res2TCNGuard/resolve/44f5a8347036114f1a4b1b7808d925e5cd0b37ce/.eval_results/SpeechAntiSpoofingBenchmarks/CD-ADD/scores.txt
README.md CHANGED
@@ -13,6 +13,7 @@ tags:
13
  [![EER% 1.5 on ASVspoof2019_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2019__LA-1.5%25-brightgreen)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
14
  [![EER% 17.02 on ASVspoof2021_DF](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__DF-17.02%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
15
  [![EER% 13.67 on ASVspoof2021_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__LA-13.67%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
 
16
  [![arena tier](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/tier.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
17
  [![arena rank](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/rank.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
18
 
@@ -71,6 +72,7 @@ crop), so the numbers are exactly reproducible from the pinned score file.
71
  | ASVspoof2019_LA | test | **1.50** | 71,237 | 0 | in-domain (training data) |
72
  | ASVspoof2021_DF | test | **17.02** | 611,829 | 0 | cross-dataset generalization |
73
  | ASVspoof2021_LA | test | **13.67** | 181,566 | 0 | cross-dataset generalization |
 
74
 
75
  The ASVspoof2019_LA result reproduces the paper's reported 1.49 % on the LA eval set.
76
  ASVspoof2021_DF is an out-of-domain test (the model was trained only on ASVspoof2019 LA),
 
13
  [![EER% 1.5 on ASVspoof2019_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2019__LA-1.5%25-brightgreen)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
14
  [![EER% 17.02 on ASVspoof2021_DF](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__DF-17.02%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
15
  [![EER% 13.67 on ASVspoof2021_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__LA-13.67%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
16
+ [![EER% 56.10 on CD-ADD](https://img.shields.io/badge/EER%25%20on%20CD--ADD-56.10%25-red)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
17
  [![arena tier](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/tier.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
18
  [![arena rank](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/rank.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
19
 
 
72
  | ASVspoof2019_LA | test | **1.50** | 71,237 | 0 | in-domain (training data) |
73
  | ASVspoof2021_DF | test | **17.02** | 611,829 | 0 | cross-dataset generalization |
74
  | ASVspoof2021_LA | test | **13.67** | 181,566 | 0 | cross-dataset generalization |
75
+ | CD-ADD | test | **56.10** | 20,786 | 0 | out-of-domain (modern neural-TTS); does not generalize |
76
 
77
  The ASVspoof2019_LA result reproduces the paper's reported 1.49 % on the LA eval set.
78
  ASVspoof2021_DF is an out-of-domain test (the model was trained only on ASVspoof2019 LA),