Spaces:
Sleeping
Sleeping
| TITLE = """<h1 id="space-title">Truth vs. Machine Hackathon Leaderboard</h1>""" | |
| INTRODUCTION_TEXT = """ | |
| Welcome to the Truth vs. Machine Hackathon Leaderboard! This leaderboard tracks teams competing in an audio deepfake detection challenge. Teams submit predictions on audio samples to determine whether they are real or fake, and the leaderboard displays the submission with the best F1 scores for each team. | |
| """ | |
| LLM_BENCHMARKS_TEXT = """ | |
| ## How it works | |
| ### 1. Register Your Team | |
| - Go to the "Register Team" tab | |
| - Enter your team name and the total number of teammates | |
| - **Save your token** - you'll need it to submit predictions and you won't be able to see your token again after registration | |
| ### 2. Exploratory Notebook | |
| To get you started quickly, we have prepared an [Exploratory Notebook](https://colab.research.google.com/drive/1cGQ5fMrNM7-YEmPTudIgN9OlA1-v0wEC) | |
| Feel free to use your computer instead of Google Colab to run the notebook | |
| ### 3. Prepare Your Predictions | |
| Create a CSV file with two columns: | |
| - `id`: The UUID identifier of the test sample (must match the test set) | |
| - `label`: Your prediction (must be exactly `0.0` for real or `1.0` for fake) | |
| Example CSV format: | |
| ```csv | |
| id,label | |
| f7e3a2c1,0.0 | |
| 8b1c4d2e,1.0 | |
| 7f5b9e8a,0.0 | |
| c2fa163b,1.0 | |
| ``` | |
| - True labels are kept private and not accessible to participants | |
| ### 4. Submit Your Predictions | |
| - Go to the "Submit Predictions" tab | |
| - Enter your team token, upload your CSV file and submit | |
| - Your submission will be automatically evaluated - There is a **rate limit** of 1 valid submission per 15 minutes per team | |
| - Only your **best** scores, selected based on F1 score, are displayed on the leaderboard | |
| ## 🏆 Prize Distribution | |
| Prizes are awarded based on the **F1 Score** metric: | |
| - 🥇 **1st Prize**: 75 CHF digitec giftcard per team member | |
| - 🥈 **2nd Prize**: 20 CHF digitec giftcard per team member | |
| - 🥉 **3rd Prize**: 20 CHF digitec giftcard per team member | |
| The final rankings will be set at the end of the hackathon, any submissions after the deadline won't count towards the prizes | |
| **Tiebreaker**: In case of equal F1 scores, the team that submitted their winning score **earlier** will be ranked higher | |
| We will also award a **Creative Prize** to the team that submits the most creative solution: | |
| - 🎨 **Creative Prize**: 20 CHF digitec giftcard per team member | |
| To select the winning team, we sadly do not have the time to evaluate each solution, so we will ask only the 6 teams with the highest F1 scores to present. | |
| """ | |