Spaces:
Sleeping
Sleeping
File size: 2,514 Bytes
ebff827 b87ce7c dcb04e7 b87ce7c 141f1e0 b87ce7c 141f1e0 dcb04e7 141f1e0 dcb04e7 b5a5f3d b017508 dcb04e7 30f0c04 141f1e0 30f0c04 141f1e0 30f0c04 dcb04e7 141f1e0 b87ce7c dcb04e7 30f0c04 141f1e0 dcb04e7 30f0c04 dcb04e7 30f0c04 dcb04e7 30f0c04 7847679 dcb04e7 b87ce7c dcb04e7 30f0c04 dcb04e7 30f0c04 c3e7c31 b87ce7c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 | TITLE = """<h1 id="space-title">Truth vs. Machine Hackathon Leaderboard</h1>"""
INTRODUCTION_TEXT = """
Welcome to the Truth vs. Machine Hackathon Leaderboard! This leaderboard tracks teams competing in an audio deepfake detection challenge. Teams submit predictions on audio samples to determine whether they are real or fake, and the leaderboard displays the submission with the best F1 scores for each team.
"""
LLM_BENCHMARKS_TEXT = """
## How it works
### 1. Register Your Team
- Go to the "Register Team" tab
- Enter your team name and the total number of teammates
- **Save your token** - you'll need it to submit predictions and you won't be able to see your token again after registration
### 2. Exploratory Notebook
To get you started quickly, we have prepared an [Exploratory Notebook](https://colab.research.google.com/drive/1cGQ5fMrNM7-YEmPTudIgN9OlA1-v0wEC)
Feel free to use your computer instead of Google Colab to run the notebook
### 3. Prepare Your Predictions
Create a CSV file with two columns:
- `id`: The UUID identifier of the test sample (must match the test set)
- `label`: Your prediction (must be exactly `0.0` for real or `1.0` for fake)
Example CSV format:
```csv
id,label
f7e3a2c1,0.0
8b1c4d2e,1.0
7f5b9e8a,0.0
c2fa163b,1.0
```
- True labels are kept private and not accessible to participants
### 4. Submit Your Predictions
- Go to the "Submit Predictions" tab
- Enter your team token, upload your CSV file and submit
- Your submission will be automatically evaluated - There is a **rate limit** of 1 valid submission per 15 minutes per team
- Only your **best** scores, selected based on F1 score, are displayed on the leaderboard
## 🏆 Prize Distribution
Prizes are awarded based on the **F1 Score** metric:
- 🥇 **1st Prize**: 75 CHF digitec giftcard per team member
- 🥈 **2nd Prize**: 20 CHF digitec giftcard per team member
- 🥉 **3rd Prize**: 20 CHF digitec giftcard per team member
The final rankings will be set at the end of the hackathon, any submissions after the deadline won't count towards the prizes
**Tiebreaker**: In case of equal F1 scores, the team that submitted their winning score **earlier** will be ranked higher
We will also award a **Creative Prize** to the team that submits the most creative solution:
- 🎨 **Creative Prize**: 20 CHF digitec giftcard per team member
To select the winning team, we sadly do not have the time to evaluate each solution, so we will ask only the 6 teams with the highest F1 scores to present.
"""
|