Spaces:
Sleeping
Sleeping
Commit ·
fecd281
1
Parent(s): 6f8e80c
update info
Browse files
about.py
CHANGED
|
@@ -1,16 +1,21 @@
|
|
| 1 |
-
TITLE = "# Mewsic
|
| 2 |
|
| 3 |
INTRODUCTION_TEXT = """
|
| 4 |
-
Welcome to the **Mewsic Bench** leaderboard!
|
|
|
|
|
|
|
| 5 |
|
| 6 |
-
I run model evaluations via their live API endpoints on request.
|
| 7 |
To request a model be evaluated, switch to the **Request Evaluation** tab and enter its model ID.
|
| 8 |
|
| 9 |
-
##
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
"""
|
| 15 |
|
| 16 |
CITATION_BUTTON_TEXT = """
|
|
|
|
| 1 |
+
TITLE = "# Mewsic Bench Leaderboard"
|
| 2 |
|
| 3 |
INTRODUCTION_TEXT = """
|
| 4 |
+
## Welcome to the **Mewsic Bench** leaderboard!
|
| 5 |
+
|
| 6 |
+
#### I run model evaluations via their live API endpoints on request.
|
| 7 |
|
|
|
|
| 8 |
To request a model be evaluated, switch to the **Request Evaluation** tab and enter its model ID.
|
| 9 |
|
| 10 |
+
## What is this anyway?
|
| 11 |
+
|
| 12 |
+
I test the lyrical capabilities of LLMs by telling them to write songs entirely in meowing.
|
| 13 |
+
|
| 14 |
+
## About the Metrics
|
| 15 |
+
|
| 16 |
+
- **Meter** - How closely the model sticks to the meter of the lines.
|
| 17 |
+
- **Verse** - How closely the model aligns the lines to the verse and chorus breakup.
|
| 18 |
+
- **Focus** - How much of the response is extraneous commentary instead of the song. Focus in particular has a very minor contribution to the final score
|
| 19 |
"""
|
| 20 |
|
| 21 |
CITATION_BUTTON_TEXT = """
|