korallll commited on
Commit
8731d1f
·
verified ·
1 Parent(s): 3ea6731

Add ASVspoof2021_DF result.yaml + README badge/row

Browse files
.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2021_DF/result.yaml ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ system:
3
+ name: Res2TCNGuard
4
+ slug: res2tcnguard
5
+ paper:
6
+ arxiv_id: 10.48084/etasr.8906
7
+ dataset:
8
+ id: SpeechAntiSpoofingBenchmarks/ASVspoof2021_DF
9
+ revision: 16d4f7d6c68694ac9b0bd43b83df322d1bc5102e
10
+ split: test
11
+ scores:
12
+ eer_percent: 17.018172171375515
13
+ n_trials: 611829
14
+ n_skipped: 0
15
+ arena:
16
+ url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena
17
+ system_url: https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard
18
+ artifact:
19
+ scores_url: https://huggingface.co/SpeechAntiSpoofingBenchmarks/Res2TCNGuard/resolve/3ea67313448591c86bbe6a62ada4ae840869e9ba/.eval_results/SpeechAntiSpoofingBenchmarks/ASVspoof2021_DF/scores.txt
README.md CHANGED
@@ -11,6 +11,7 @@ tags:
11
  # Res2TCNGuard
12
 
13
  [![EER% 1.5 on ASVspoof2019_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2019__LA-1.5%25-brightgreen)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
 
14
  [![arena tier](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/tier.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
15
  [![arena rank](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/rank.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
16
 
@@ -64,11 +65,14 @@ Evaluated through the reproducible [Speech Anti-Spoofing Arena](https://huggingf
64
  Scores were computed with a **deterministic first-64,600-sample window** (no random
65
  crop), so the numbers are exactly reproducible from the pinned score file.
66
 
67
- | Dataset | Split | EER % | Trials | Skipped |
68
- |---|---|---|---|---|
69
- | ASVspoof2019_LA | test | **1.50** | 71,237 | 0 |
 
70
 
71
- This reproduces the paper's reported 1.49 % on the ASVspoof 2019 LA eval set.
 
 
72
 
73
  ## Usage
74
 
 
11
  # Res2TCNGuard
12
 
13
  [![EER% 1.5 on ASVspoof2019_LA](https://img.shields.io/badge/EER%25%20on%20ASVspoof2019__LA-1.5%25-brightgreen)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
14
+ [![EER% 17.02 on ASVspoof2021_DF](https://img.shields.io/badge/EER%25%20on%20ASVspoof2021__DF-17.02%25-yellow)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
15
  [![arena tier](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/tier.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
16
  [![arena rank](https://img.shields.io/endpoint?url=https://speechantispoofingbenchmarks-speechantispoofingarena.hf.space/badge/res2tcnguard/rank.json)](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=res2tcnguard)
17
 
 
65
  Scores were computed with a **deterministic first-64,600-sample window** (no random
66
  crop), so the numbers are exactly reproducible from the pinned score file.
67
 
68
+ | Dataset | Split | EER % | Trials | Skipped | Notes |
69
+ |---|---|---|---|---|---|
70
+ | ASVspoof2019_LA | test | **1.50** | 71,237 | 0 | in-domain (training data) |
71
+ | ASVspoof2021_DF | test | **17.02** | 611,829 | 0 | cross-dataset generalization |
72
 
73
+ The ASVspoof2019_LA result reproduces the paper's reported 1.49 % on the LA eval set.
74
+ ASVspoof2021_DF is an out-of-domain test (the model was trained only on ASVspoof2019 LA),
75
+ so a higher EER is expected — it measures generalization to newer, unseen attacks.
76
 
77
  ## Usage
78