Spaces:
Sleeping
Sleeping
Update app.py
Browse files
app.py
CHANGED
|
@@ -30,6 +30,7 @@ st.markdown("""
|
|
| 30 |
gap: 1px;
|
| 31 |
padding-top: 10px;
|
| 32 |
padding-bottom: 10px;
|
|
|
|
| 33 |
}
|
| 34 |
.stTabs [aria-selected="true"] {
|
| 35 |
background-color: #4e8df5;
|
|
@@ -61,17 +62,18 @@ st.markdown("""
|
|
| 61 |
}
|
| 62 |
.metric-title {
|
| 63 |
font-size: 16px;
|
| 64 |
-
color: #
|
| 65 |
margin-bottom: 5px;
|
| 66 |
}
|
| 67 |
.metric-value {
|
| 68 |
font-size: 30px;
|
| 69 |
font-weight: bold;
|
|
|
|
| 70 |
margin-bottom: 10px;
|
| 71 |
}
|
| 72 |
.model-badge {
|
| 73 |
background-color: #4e8df5;
|
| 74 |
-
color: white;
|
| 75 |
padding: 4px 12px;
|
| 76 |
border-radius: 15px;
|
| 77 |
font-weight: bold;
|
|
@@ -135,15 +137,9 @@ data = {
|
|
| 135 |
|
| 136 |
df = pd.DataFrame(data)
|
| 137 |
|
| 138 |
-
# Your models filter
|
| 139 |
your_models = ["OpenElla-Llama-3-2B", "MiniMaid-L1", "MiniMaid-L2", "MiniMaid-L3"]
|
| 140 |
-
|
| 141 |
-
df_your_models["Is Your Model"] = "Yes"
|
| 142 |
-
|
| 143 |
-
df_others = df[~df["Model"].isin(your_models)].copy()
|
| 144 |
-
df_others["Is Your Model"] = "No"
|
| 145 |
-
|
| 146 |
-
df_all = pd.concat([df_your_models, df_others])
|
| 147 |
|
| 148 |
# Sidebar
|
| 149 |
st.sidebar.markdown("<h2>Leaderboard Controls</h2>", unsafe_allow_html=True)
|
|
@@ -230,8 +226,8 @@ with tab1:
|
|
| 230 |
filtered_df,
|
| 231 |
x="Model",
|
| 232 |
y="Overall Score",
|
| 233 |
-
color="
|
| 234 |
-
color_discrete_map={"
|
| 235 |
text_auto='.2f',
|
| 236 |
title="Overall Roleplay Performance",
|
| 237 |
height=400
|
|
@@ -257,8 +253,8 @@ with tab1:
|
|
| 257 |
filtered_df,
|
| 258 |
x="Model",
|
| 259 |
y=metric,
|
| 260 |
-
color="
|
| 261 |
-
color_discrete_map={"
|
| 262 |
text_auto='.2f',
|
| 263 |
title=f"{metric}",
|
| 264 |
height=350
|
|
@@ -383,25 +379,25 @@ with tab3:
|
|
| 383 |
st.markdown("""
|
| 384 |
<div class="card openella-card">
|
| 385 |
<h3>OpenElla-Llama-3-2B</h3>
|
| 386 |
-
<div class="model-badge">OpenElla</div>
|
| 387 |
-
<div class="model-badge">2B Parameters</div>
|
| 388 |
-
<div class="model-badge">Released: February 2024</div>
|
| 389 |
<hr>
|
| 390 |
<p>OpenElla-Llama-3-2B is optimized for roleplay with excellent character consistency
|
| 391 |
and good immersion capabilities. Built on the Llama 3 architecture, this model
|
| 392 |
delivers impressively balanced performance despite its compact 2B parameter size.</p>
|
| 393 |
<div style="display: flex; margin-top: 15px;">
|
| 394 |
<div style="flex: 1; text-align: center;">
|
| 395 |
-
<div class="metric-title">Overall Score</div>
|
| 396 |
-
<div class="metric-value">0.83</div>
|
| 397 |
</div>
|
| 398 |
<div style="flex: 1; text-align: center;">
|
| 399 |
-
<div class="metric-title">Character Consistency</div>
|
| 400 |
-
<div class="metric-value">0.83</div>
|
| 401 |
</div>
|
| 402 |
<div style="flex: 1; text-align: center;">
|
| 403 |
-
<div class="metric-title">Immersion</div>
|
| 404 |
-
<div class="metric-value">0.67</div>
|
| 405 |
</div>
|
| 406 |
</div>
|
| 407 |
</div>
|
|
@@ -412,25 +408,25 @@ with tab3:
|
|
| 412 |
st.markdown("""
|
| 413 |
<div class="card minimaid-l1-card">
|
| 414 |
<h3>MiniMaid-L1</h3>
|
| 415 |
-
<div class="model-badge">MiniMaid</div>
|
| 416 |
-
<div class="model-badge">1B Parameters</div>
|
| 417 |
-
<div class="model-badge">Released: January 2024</div>
|
| 418 |
<hr>
|
| 419 |
<p>MiniMaid-L1 is the first generation of the MiniMaid series, designed for maximum speed and efficiency.
|
| 420 |
With only 1B parameters, it's optimized for low-resource environments while still maintaining
|
| 421 |
good length handling capabilities.</p>
|
| 422 |
<div style="display: flex; margin-top: 15px;">
|
| 423 |
<div style="flex: 1; text-align: center;">
|
| 424 |
-
<div class="metric-title">Overall Score</div>
|
| 425 |
-
<div class="metric-value">0.51</div>
|
| 426 |
</div>
|
| 427 |
<div style="flex: 1; text-align: center;">
|
| 428 |
-
<div class="metric-title">Character Consistency</div>
|
| 429 |
-
<div class="metric-value">0.50</div>
|
| 430 |
</div>
|
| 431 |
<div style="flex: 1; text-align: center;">
|
| 432 |
-
<div class="metric-title">Speed</div>
|
| 433 |
-
<div class="metric-value">320 t/s</div>
|
| 434 |
</div>
|
| 435 |
</div>
|
| 436 |
</div>
|
|
@@ -440,25 +436,25 @@ with tab3:
|
|
| 440 |
st.markdown("""
|
| 441 |
<div class="card minimaid-l2-card">
|
| 442 |
<h3>MiniMaid-L2</h3>
|
| 443 |
-
<div class="model-badge">MiniMaid</div>
|
| 444 |
-
<div class="model-badge">1.5B Parameters</div>
|
| 445 |
-
<div class="model-badge">Released: March 2024</div>
|
| 446 |
<hr>
|
| 447 |
<p>MiniMaid-L2 represents a significant improvement over L1, with enhanced immersion capabilities
|
| 448 |
and better overall roleplay performance. The model retains excellent efficiency while delivering
|
| 449 |
more engaging and consistent character portrayals.</p>
|
| 450 |
<div style="display: flex; margin-top: 15px;">
|
| 451 |
<div style="flex: 1; text-align: center;">
|
| 452 |
-
<div class="metric-title">Overall Score</div>
|
| 453 |
-
<div class="metric-value">0.71</div>
|
| 454 |
</div>
|
| 455 |
<div style="flex: 1; text-align: center;">
|
| 456 |
-
<div class="metric-title">Immersion</div>
|
| 457 |
-
<div class="metric-value">0.60</div>
|
| 458 |
</div>
|
| 459 |
<div style="flex: 1; text-align: center;">
|
| 460 |
-
<div class="metric-title">Speed</div>
|
| 461 |
-
<div class="metric-value">280 t/s</div>
|
| 462 |
</div>
|
| 463 |
</div>
|
| 464 |
</div>
|
|
@@ -468,25 +464,25 @@ with tab3:
|
|
| 468 |
st.markdown("""
|
| 469 |
<div class="card minimaid-l3-card">
|
| 470 |
<h3>MiniMaid-L3</h3>
|
| 471 |
-
<div class="model-badge">MiniMaid</div>
|
| 472 |
-
<div class="model-badge">2.5B Parameters</div>
|
| 473 |
-
<div class="model-badge">Released: April 2024</div>
|
| 474 |
<hr>
|
| 475 |
<p>MiniMaid-L3 is the latest and most advanced model in the MiniMaid series. With 2.5B parameters,
|
| 476 |
it achieves the highest immersion score of all models while maintaining excellent length handling.
|
| 477 |
This model represents the pinnacle of the MiniMaid series' development.</p>
|
| 478 |
<div style="display: flex; margin-top: 15px;">
|
| 479 |
<div style="flex: 1; text-align: center;">
|
| 480 |
-
<div class="metric-title">Overall Score</div>
|
| 481 |
-
<div class="metric-value">0.76</div>
|
| 482 |
</div>
|
| 483 |
<div style="flex: 1; text-align: center;">
|
| 484 |
-
<div class="metric-title">Immersion</div>
|
| 485 |
-
<div class="metric-value">0.73</div>
|
| 486 |
</div>
|
| 487 |
<div style="flex: 1; text-align: center;">
|
| 488 |
-
<div class="metric-title">Length Score</div>
|
| 489 |
-
<div class="metric-value">1.00</div>
|
| 490 |
</div>
|
| 491 |
</div>
|
| 492 |
</div>
|
|
@@ -503,10 +499,10 @@ with tab3:
|
|
| 503 |
st.markdown(f"""
|
| 504 |
<div class="card">
|
| 505 |
<h4>{model}</h4>
|
| 506 |
-
<div class="model-badge">{model_data['Family']}</div>
|
| 507 |
-
<div class="model-badge">{model_data['Parameters (B)']}B</div>
|
| 508 |
<p>{model_data['Description']}</p>
|
| 509 |
-
<p><b>Overall Score:</b> {model_data['Overall Score']:.2f}</p>
|
| 510 |
</div>
|
| 511 |
""", unsafe_allow_html=True)
|
| 512 |
|
|
|
|
| 30 |
gap: 1px;
|
| 31 |
padding-top: 10px;
|
| 32 |
padding-bottom: 10px;
|
| 33 |
+
color: #333333;
|
| 34 |
}
|
| 35 |
.stTabs [aria-selected="true"] {
|
| 36 |
background-color: #4e8df5;
|
|
|
|
| 62 |
}
|
| 63 |
.metric-title {
|
| 64 |
font-size: 16px;
|
| 65 |
+
color: #333333 !important;
|
| 66 |
margin-bottom: 5px;
|
| 67 |
}
|
| 68 |
.metric-value {
|
| 69 |
font-size: 30px;
|
| 70 |
font-weight: bold;
|
| 71 |
+
color: #333333 !important;
|
| 72 |
margin-bottom: 10px;
|
| 73 |
}
|
| 74 |
.model-badge {
|
| 75 |
background-color: #4e8df5;
|
| 76 |
+
color: white !important;
|
| 77 |
padding: 4px 12px;
|
| 78 |
border-radius: 15px;
|
| 79 |
font-weight: bold;
|
|
|
|
| 137 |
|
| 138 |
df = pd.DataFrame(data)
|
| 139 |
|
| 140 |
+
# Your models filter
|
| 141 |
your_models = ["OpenElla-Llama-3-2B", "MiniMaid-L1", "MiniMaid-L2", "MiniMaid-L3"]
|
| 142 |
+
# Instead of creating a separate column, we'll use the 'Family' column for coloring
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 143 |
|
| 144 |
# Sidebar
|
| 145 |
st.sidebar.markdown("<h2>Leaderboard Controls</h2>", unsafe_allow_html=True)
|
|
|
|
| 226 |
filtered_df,
|
| 227 |
x="Model",
|
| 228 |
y="Overall Score",
|
| 229 |
+
color="Family" if highlight_yours else None,
|
| 230 |
+
color_discrete_map={"OpenElla": "#4e8df5", "MiniMaid": "#f5854e", "DeepSeek": "#aaaaaa", "Dolphin": "#aaaaaa", "Hermes": "#aaaaaa"},
|
| 231 |
text_auto='.2f',
|
| 232 |
title="Overall Roleplay Performance",
|
| 233 |
height=400
|
|
|
|
| 253 |
filtered_df,
|
| 254 |
x="Model",
|
| 255 |
y=metric,
|
| 256 |
+
color="Family" if highlight_yours else None,
|
| 257 |
+
color_discrete_map={"OpenElla": "#4e8df5", "MiniMaid": "#f5854e", "DeepSeek": "#aaaaaa", "Dolphin": "#aaaaaa", "Hermes": "#aaaaaa"},
|
| 258 |
text_auto='.2f',
|
| 259 |
title=f"{metric}",
|
| 260 |
height=350
|
|
|
|
| 379 |
st.markdown("""
|
| 380 |
<div class="card openella-card">
|
| 381 |
<h3>OpenElla-Llama-3-2B</h3>
|
| 382 |
+
<div class="model-badge" style="color: white;">OpenElla</div>
|
| 383 |
+
<div class="model-badge" style="color: white;">2B Parameters</div>
|
| 384 |
+
<div class="model-badge" style="color: white;">Released: February 2024</div>
|
| 385 |
<hr>
|
| 386 |
<p>OpenElla-Llama-3-2B is optimized for roleplay with excellent character consistency
|
| 387 |
and good immersion capabilities. Built on the Llama 3 architecture, this model
|
| 388 |
delivers impressively balanced performance despite its compact 2B parameter size.</p>
|
| 389 |
<div style="display: flex; margin-top: 15px;">
|
| 390 |
<div style="flex: 1; text-align: center;">
|
| 391 |
+
<div class="metric-title" style="color: #333333;">Overall Score</div>
|
| 392 |
+
<div class="metric-value" style="color: #333333;">0.83</div>
|
| 393 |
</div>
|
| 394 |
<div style="flex: 1; text-align: center;">
|
| 395 |
+
<div class="metric-title" style="color: #333333;">Character Consistency</div>
|
| 396 |
+
<div class="metric-value" style="color: #333333;">0.83</div>
|
| 397 |
</div>
|
| 398 |
<div style="flex: 1; text-align: center;">
|
| 399 |
+
<div class="metric-title" style="color: #333333;">Immersion</div>
|
| 400 |
+
<div class="metric-value" style="color: #333333;">0.67</div>
|
| 401 |
</div>
|
| 402 |
</div>
|
| 403 |
</div>
|
|
|
|
| 408 |
st.markdown("""
|
| 409 |
<div class="card minimaid-l1-card">
|
| 410 |
<h3>MiniMaid-L1</h3>
|
| 411 |
+
<div class="model-badge" style="color: white;">MiniMaid</div>
|
| 412 |
+
<div class="model-badge" style="color: white;">1B Parameters</div>
|
| 413 |
+
<div class="model-badge" style="color: white;">Released: January 2024</div>
|
| 414 |
<hr>
|
| 415 |
<p>MiniMaid-L1 is the first generation of the MiniMaid series, designed for maximum speed and efficiency.
|
| 416 |
With only 1B parameters, it's optimized for low-resource environments while still maintaining
|
| 417 |
good length handling capabilities.</p>
|
| 418 |
<div style="display: flex; margin-top: 15px;">
|
| 419 |
<div style="flex: 1; text-align: center;">
|
| 420 |
+
<div class="metric-title" style="color: #333333;">Overall Score</div>
|
| 421 |
+
<div class="metric-value" style="color: #333333;">0.51</div>
|
| 422 |
</div>
|
| 423 |
<div style="flex: 1; text-align: center;">
|
| 424 |
+
<div class="metric-title" style="color: #333333;">Character Consistency</div>
|
| 425 |
+
<div class="metric-value" style="color: #333333;">0.50</div>
|
| 426 |
</div>
|
| 427 |
<div style="flex: 1; text-align: center;">
|
| 428 |
+
<div class="metric-title" style="color: #333333;">Speed</div>
|
| 429 |
+
<div class="metric-value" style="color: #333333;">320 t/s</div>
|
| 430 |
</div>
|
| 431 |
</div>
|
| 432 |
</div>
|
|
|
|
| 436 |
st.markdown("""
|
| 437 |
<div class="card minimaid-l2-card">
|
| 438 |
<h3>MiniMaid-L2</h3>
|
| 439 |
+
<div class="model-badge" style="color: white;">MiniMaid</div>
|
| 440 |
+
<div class="model-badge" style="color: white;">1.5B Parameters</div>
|
| 441 |
+
<div class="model-badge" style="color: white;">Released: March 2024</div>
|
| 442 |
<hr>
|
| 443 |
<p>MiniMaid-L2 represents a significant improvement over L1, with enhanced immersion capabilities
|
| 444 |
and better overall roleplay performance. The model retains excellent efficiency while delivering
|
| 445 |
more engaging and consistent character portrayals.</p>
|
| 446 |
<div style="display: flex; margin-top: 15px;">
|
| 447 |
<div style="flex: 1; text-align: center;">
|
| 448 |
+
<div class="metric-title" style="color: #333333;">Overall Score</div>
|
| 449 |
+
<div class="metric-value" style="color: #333333;">0.71</div>
|
| 450 |
</div>
|
| 451 |
<div style="flex: 1; text-align: center;">
|
| 452 |
+
<div class="metric-title" style="color: #333333;">Immersion</div>
|
| 453 |
+
<div class="metric-value" style="color: #333333;">0.60</div>
|
| 454 |
</div>
|
| 455 |
<div style="flex: 1; text-align: center;">
|
| 456 |
+
<div class="metric-title" style="color: #333333;">Speed</div>
|
| 457 |
+
<div class="metric-value" style="color: #333333;">280 t/s</div>
|
| 458 |
</div>
|
| 459 |
</div>
|
| 460 |
</div>
|
|
|
|
| 464 |
st.markdown("""
|
| 465 |
<div class="card minimaid-l3-card">
|
| 466 |
<h3>MiniMaid-L3</h3>
|
| 467 |
+
<div class="model-badge" style="color: white;">MiniMaid</div>
|
| 468 |
+
<div class="model-badge" style="color: white;">2.5B Parameters</div>
|
| 469 |
+
<div class="model-badge" style="color: white;">Released: April 2024</div>
|
| 470 |
<hr>
|
| 471 |
<p>MiniMaid-L3 is the latest and most advanced model in the MiniMaid series. With 2.5B parameters,
|
| 472 |
it achieves the highest immersion score of all models while maintaining excellent length handling.
|
| 473 |
This model represents the pinnacle of the MiniMaid series' development.</p>
|
| 474 |
<div style="display: flex; margin-top: 15px;">
|
| 475 |
<div style="flex: 1; text-align: center;">
|
| 476 |
+
<div class="metric-title" style="color: #333333;">Overall Score</div>
|
| 477 |
+
<div class="metric-value" style="color: #333333;">0.76</div>
|
| 478 |
</div>
|
| 479 |
<div style="flex: 1; text-align: center;">
|
| 480 |
+
<div class="metric-title" style="color: #333333;">Immersion</div>
|
| 481 |
+
<div class="metric-value" style="color: #333333;">0.73</div>
|
| 482 |
</div>
|
| 483 |
<div style="flex: 1; text-align: center;">
|
| 484 |
+
<div class="metric-title" style="color: #333333;">Length Score</div>
|
| 485 |
+
<div class="metric-value" style="color: #333333;">1.00</div>
|
| 486 |
</div>
|
| 487 |
</div>
|
| 488 |
</div>
|
|
|
|
| 499 |
st.markdown(f"""
|
| 500 |
<div class="card">
|
| 501 |
<h4>{model}</h4>
|
| 502 |
+
<div class="model-badge" style="color: white !important;">{model_data['Family']}</div>
|
| 503 |
+
<div class="model-badge" style="color: white !important;">{model_data['Parameters (B)']}B</div>
|
| 504 |
<p>{model_data['Description']}</p>
|
| 505 |
+
<p style="color: #333333;"><b>Overall Score:</b> {model_data['Overall Score']:.2f}</p>
|
| 506 |
</div>
|
| 507 |
""", unsafe_allow_html=True)
|
| 508 |
|