File size: 2,514 Bytes
ebff827
b87ce7c
 
dcb04e7
b87ce7c
 
141f1e0
b87ce7c
 
141f1e0
 
dcb04e7
 
141f1e0
dcb04e7
b5a5f3d
b017508
dcb04e7
30f0c04
 
141f1e0
30f0c04
 
141f1e0
 
 
30f0c04
dcb04e7
 
 
 
141f1e0
b87ce7c
dcb04e7
 
30f0c04
141f1e0
dcb04e7
 
 
30f0c04
dcb04e7
30f0c04
 
 
dcb04e7
 
 
30f0c04
7847679
 
dcb04e7
b87ce7c
dcb04e7
30f0c04
dcb04e7
30f0c04
c3e7c31
b87ce7c
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
TITLE = """<h1 id="space-title">Truth vs. Machine Hackathon Leaderboard</h1>"""

INTRODUCTION_TEXT = """
Welcome to the Truth vs. Machine Hackathon Leaderboard! This leaderboard tracks teams competing in an audio deepfake detection challenge. Teams submit predictions on audio samples to determine whether they are real or fake, and the leaderboard displays the submission with the best F1 scores for each team.
"""

LLM_BENCHMARKS_TEXT = """
## How it works

### 1. Register Your Team
- Go to the "Register Team" tab
- Enter your team name and the total number of teammates
- **Save your token** - you'll need it to submit predictions and you won't be able to see your token again after registration

### 2. Exploratory Notebook
To get you started quickly, we have prepared an [Exploratory Notebook](https://colab.research.google.com/drive/1cGQ5fMrNM7-YEmPTudIgN9OlA1-v0wEC)

Feel free to use your computer instead of Google Colab to run the notebook

### 3. Prepare Your Predictions
Create a CSV file with two columns:
- `id`: The UUID identifier of the test sample (must match the test set)
- `label`: Your prediction (must be exactly `0.0` for real or `1.0` for fake)

Example CSV format:
```csv
id,label
f7e3a2c1,0.0
8b1c4d2e,1.0
7f5b9e8a,0.0
c2fa163b,1.0
```

- True labels are kept private and not accessible to participants

### 4. Submit Your Predictions
- Go to the "Submit Predictions" tab
- Enter your team token, upload your CSV file and submit
- Your submission will be automatically evaluated - There is a **rate limit** of 1 valid submission per 15 minutes per team
- Only your **best** scores, selected based on F1 score, are displayed on the leaderboard

## 🏆 Prize Distribution

Prizes are awarded based on the **F1 Score** metric:

- 🥇 **1st Prize**: 75 CHF digitec giftcard per team member
- 🥈 **2nd Prize**: 20 CHF digitec giftcard per team member
- 🥉 **3rd Prize**: 20 CHF digitec giftcard per team member

The final rankings will be set at the end of the hackathon, any submissions after the deadline won't count towards the prizes

**Tiebreaker**: In case of equal F1 scores, the team that submitted their winning score **earlier** will be ranked higher

We will also award a **Creative Prize** to the team that submits the most creative solution:

- 🎨 **Creative Prize**: 20 CHF digitec giftcard per team member

To select the winning team, we sadly do not have the time to evaluate each solution, so we will ask only the 6 teams with the highest F1 scores to present.
"""