Spaces:
Build error
Build error
Commit ·
48cd5b5
1
Parent(s): ad324d8
Auto Daily Leaderboard udpate Thu Jan 30 12:00:32 PM EST 2025
Browse files- arena_elo/results/20250129/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20250129/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20250129/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/20250130/clean_battle_video_generation.json +0 -0
- arena_elo/results/20250130/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20250130/video_generation_leaderboard.csv +16 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +14 -0
- arena_elo/results/latest/clean_battle_video_generation.json +154 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +2 -2
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
- arena_elo/results/latest/video_generation_leaderboard.csv +15 -15
arena_elo/results/20250129/clean_battle_t2i_generation.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
arena_elo/results/20250129/elo_results_t2i_generation.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:725c8b9c31176242913fee6715928e0a8c3faeedcba5daa1672a222a2161f550
|
| 3 |
+
size 88250
|
arena_elo/results/20250129/t2i_generation_leaderboard.csv
ADDED
|
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
FLUX.1-dev,FLUX.1-dev,1133.51320656307,1135.6106605853138,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 3 |
+
PlayGround V2.5,PlayGround V2.5,1115.5650664166171,1116.656560423584,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
| 4 |
+
FLUX.1-schnell,FLUX.1-schnell,1091.2263845021516,1097.8195526242403,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 5 |
+
PlayGround V2,PlayGround V2,1071.5024886363958,1071.314163888098,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
| 6 |
+
Kolors,Kolors,1053.3421877076214,1052.4074297605216,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
| 7 |
+
StableCascade,StableCascade,1041.7389350063136,1044.3826154433414,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
| 8 |
+
HunyuanDiT,HunyuanDiT,1023.0629845184011,1017.5528331262328,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
| 9 |
+
PixArtAlpha,PixArtAlpha,1019.6747531812322,1012.1134622168482,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
| 10 |
+
SDXL-Lightning,SDXL-Lightning,1018.6247821770202,1022.9053444075905,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
| 11 |
+
PixArtSigma,PixArtSigma,1017.9091275643414,1018.1018308191997,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
| 12 |
+
SD3,SD3,1010.9185635588934,1011.9582670583991,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
| 13 |
+
AuraFlow,AuraFlow,1000.6473559022509,997.3093798257966,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
| 14 |
+
SDXL,SDXL,964.3575463871532,966.2474951980506,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
| 15 |
+
SDXLTurbo,SDXLTurbo,912.9567286608586,911.3598127178495,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
| 16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.4652039963336,898.8456201267345,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
| 17 |
+
OpenJourney,OpenJourney,831.0181931921011,826.6770833292192,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
| 18 |
+
LCM,LCM,789.476492029242,804.4048353625417,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/20250130/clean_battle_video_generation.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
arena_elo/results/20250130/elo_results_video_generation.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:afe6c975568a6d19d4c7b4ca86c4a12928b27145b93c6f932f223654f06c9ceb
|
| 3 |
+
size 81355
|
arena_elo/results/20250130/video_generation_leaderboard.csv
ADDED
|
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
CogVideoX-5B,CogVideoX-5B,1158.015140037087,1154.482244262217,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 3 |
+
StableVideoDiffusion,StableVideoDiffusion,1119.4743099303432,1122.0570174876473,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
| 4 |
+
Pyramid Flow,Pyramid Flow,1109.5530804756415,1112.5241213182721,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
| 5 |
+
Mochi1,Mochi1,1104.4363165816096,1105.5206995717626,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
| 6 |
+
T2V-Turbo,T2V-Turbo,1057.8651235974799,1059.1983191890347,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
| 7 |
+
CogVideoX-2B,CogVideoX-2B,1049.051937893046,1047.4096122728752,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 8 |
+
AnimateDiff,AnimateDiff,1038.6583163447103,1039.4570307535914,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
| 9 |
+
VideoCrafter2,VideoCrafter2,1032.3141804376194,1032.676093890844,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
| 10 |
+
Allegro,Allegro,993.0540302426419,996.7276200816042,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
| 11 |
+
LTXVideo,LTXVideo,968.7030858293559,962.0542061213175,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
| 12 |
+
LaVie,LaVie,965.5910073484995,966.1766083145712,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
| 13 |
+
OpenSora,OpenSora,881.9642309092337,882.1876176582986,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 14 |
+
OpenSora v1.2,OpenSora v1.2,853.6334118642726,851.4677677123974,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,835.795070428639,834.4576004760767,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
| 16 |
+
ModelScope,ModelScope,831.89075807982,833.6034408894933,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
|
@@ -116306,5 +116306,19 @@
|
|
| 116306 |
"judge": "arena_user_10.16.17.134",
|
| 116307 |
"anony": true,
|
| 116308 |
"tstamp": 1738121502.1636
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 116309 |
}
|
| 116310 |
]
|
|
|
|
| 116306 |
"judge": "arena_user_10.16.17.134",
|
| 116307 |
"anony": true,
|
| 116308 |
"tstamp": 1738121502.1636
|
| 116309 |
+
},
|
| 116310 |
+
{
|
| 116311 |
+
"model_a_conv_id": "4b72272f08204af4a5f93f9770eb64e8",
|
| 116312 |
+
"model_b_conv_id": "8cdc997b7eb44a5bb332aff71876b4c0",
|
| 116313 |
+
"inputs": {
|
| 116314 |
+
"prompt": "a black and white cat sitting on a brown suitcase next to a wall"
|
| 116315 |
+
},
|
| 116316 |
+
"model_a": "AuraFlow",
|
| 116317 |
+
"model_b": "SD3",
|
| 116318 |
+
"vote_type": "leftvote",
|
| 116319 |
+
"winner": "model_a",
|
| 116320 |
+
"judge": "arena_user_10.16.17.80",
|
| 116321 |
+
"anony": true,
|
| 116322 |
+
"tstamp": 1738174582.2498
|
| 116323 |
}
|
| 116324 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
|
@@ -37728,5 +37728,159 @@
|
|
| 37728 |
"judge": "arena_user_10.16.39.228",
|
| 37729 |
"anony": true,
|
| 37730 |
"tstamp": 1738003988.4999
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37731 |
}
|
| 37732 |
]
|
|
|
|
| 37728 |
"judge": "arena_user_10.16.39.228",
|
| 37729 |
"anony": true,
|
| 37730 |
"tstamp": 1738003988.4999
|
| 37731 |
+
},
|
| 37732 |
+
{
|
| 37733 |
+
"model_a_conv_id": "1970cf5e4bec4b169b7107ce998631d4",
|
| 37734 |
+
"model_b_conv_id": "376f17d5f83e4d34bfc76dc31e6dce37",
|
| 37735 |
+
"inputs": {
|
| 37736 |
+
"prompt": "a pink clock"
|
| 37737 |
+
},
|
| 37738 |
+
"model_a": "Pyramid Flow",
|
| 37739 |
+
"model_b": "Mochi1",
|
| 37740 |
+
"vote_type": "rightvote",
|
| 37741 |
+
"winner": "model_b",
|
| 37742 |
+
"judge": "arena_user_10.16.17.80",
|
| 37743 |
+
"anony": true,
|
| 37744 |
+
"tstamp": 1738244598.1614
|
| 37745 |
+
},
|
| 37746 |
+
{
|
| 37747 |
+
"model_a_conv_id": "f91f91436ca34e8ba248ed809fd6782e",
|
| 37748 |
+
"model_b_conv_id": "2c92604a6a6b4613821b8dcff038ebff",
|
| 37749 |
+
"inputs": {
|
| 37750 |
+
"prompt": "A polar bear is playing guitar"
|
| 37751 |
+
},
|
| 37752 |
+
"model_a": "Pyramid Flow",
|
| 37753 |
+
"model_b": "Mochi1",
|
| 37754 |
+
"vote_type": "rightvote",
|
| 37755 |
+
"winner": "model_b",
|
| 37756 |
+
"judge": "arena_user_10.16.17.80",
|
| 37757 |
+
"anony": true,
|
| 37758 |
+
"tstamp": 1738244612.0919
|
| 37759 |
+
},
|
| 37760 |
+
{
|
| 37761 |
+
"model_a_conv_id": "db2e0d9cdaa342d8b25a1964f5ff86d9",
|
| 37762 |
+
"model_b_conv_id": "2f516fd3b9e0492d9106f52f4ed33a4f",
|
| 37763 |
+
"inputs": {
|
| 37764 |
+
"prompt": "happy dog wearing a yellow turtleneck, studio, portrait, facing camera, dark background"
|
| 37765 |
+
},
|
| 37766 |
+
"model_a": "Mochi1",
|
| 37767 |
+
"model_b": "VideoCrafter2",
|
| 37768 |
+
"vote_type": "rightvote",
|
| 37769 |
+
"winner": "model_b",
|
| 37770 |
+
"judge": "arena_user_10.16.17.80",
|
| 37771 |
+
"anony": true,
|
| 37772 |
+
"tstamp": 1738244623.1478
|
| 37773 |
+
},
|
| 37774 |
+
{
|
| 37775 |
+
"model_a_conv_id": "043e4ecf0f584563bd3a01f30f941333",
|
| 37776 |
+
"model_b_conv_id": "25734281c47f4dd294be6f3ee8a4e105",
|
| 37777 |
+
"inputs": {
|
| 37778 |
+
"prompt": "A person is cutting watermelon"
|
| 37779 |
+
},
|
| 37780 |
+
"model_a": "Mochi1",
|
| 37781 |
+
"model_b": "Pyramid Flow",
|
| 37782 |
+
"vote_type": "leftvote",
|
| 37783 |
+
"winner": "model_a",
|
| 37784 |
+
"judge": "arena_user_10.16.17.80",
|
| 37785 |
+
"anony": true,
|
| 37786 |
+
"tstamp": 1738244635.0205
|
| 37787 |
+
},
|
| 37788 |
+
{
|
| 37789 |
+
"model_a_conv_id": "14349a51e57a43fba2fe167136b1ed9c",
|
| 37790 |
+
"model_b_conv_id": "b71d02fbc5234cdeb222be6103d2d12f",
|
| 37791 |
+
"inputs": {
|
| 37792 |
+
"prompt": "In a still frame, phone booth"
|
| 37793 |
+
},
|
| 37794 |
+
"model_a": "Mochi1",
|
| 37795 |
+
"model_b": "CogVideoX-2B",
|
| 37796 |
+
"vote_type": "rightvote",
|
| 37797 |
+
"winner": "model_b",
|
| 37798 |
+
"judge": "arena_user_10.16.46.168",
|
| 37799 |
+
"anony": true,
|
| 37800 |
+
"tstamp": 1738244645.3285
|
| 37801 |
+
},
|
| 37802 |
+
{
|
| 37803 |
+
"model_a_conv_id": "c9296f92afe449c585aeb655ef40badc",
|
| 37804 |
+
"model_b_conv_id": "69858e72987e497f9b0c68b865430fbc",
|
| 37805 |
+
"inputs": {
|
| 37806 |
+
"prompt": "a bicycle leaning against a tree"
|
| 37807 |
+
},
|
| 37808 |
+
"model_a": "Mochi1",
|
| 37809 |
+
"model_b": "Pyramid Flow",
|
| 37810 |
+
"vote_type": "leftvote",
|
| 37811 |
+
"winner": "model_a",
|
| 37812 |
+
"judge": "arena_user_10.16.17.80",
|
| 37813 |
+
"anony": true,
|
| 37814 |
+
"tstamp": 1738244655.2942
|
| 37815 |
+
},
|
| 37816 |
+
{
|
| 37817 |
+
"model_a_conv_id": "faa15a7c81c94e4495fb0763af3c024e",
|
| 37818 |
+
"model_b_conv_id": "2b418c21eb454e7188edd922b8a3601f",
|
| 37819 |
+
"inputs": {
|
| 37820 |
+
"prompt": "castle"
|
| 37821 |
+
},
|
| 37822 |
+
"model_a": "CogVideoX-2B",
|
| 37823 |
+
"model_b": "Mochi1",
|
| 37824 |
+
"vote_type": "rightvote",
|
| 37825 |
+
"winner": "model_b",
|
| 37826 |
+
"judge": "arena_user_10.16.17.80",
|
| 37827 |
+
"anony": true,
|
| 37828 |
+
"tstamp": 1738244664.7514
|
| 37829 |
+
},
|
| 37830 |
+
{
|
| 37831 |
+
"model_a_conv_id": "ccd61574e73d4306a477837845d3db02",
|
| 37832 |
+
"model_b_conv_id": "3abd544c94fd45a4b549e67e4c540c06",
|
| 37833 |
+
"inputs": {
|
| 37834 |
+
"prompt": "ballroom"
|
| 37835 |
+
},
|
| 37836 |
+
"model_a": "OpenSora v1.2",
|
| 37837 |
+
"model_b": "Mochi1",
|
| 37838 |
+
"vote_type": "leftvote",
|
| 37839 |
+
"winner": "model_a",
|
| 37840 |
+
"judge": "arena_user_10.16.46.168",
|
| 37841 |
+
"anony": true,
|
| 37842 |
+
"tstamp": 1738244674.1165
|
| 37843 |
+
},
|
| 37844 |
+
{
|
| 37845 |
+
"model_a_conv_id": "63a77f36f4804f8aa0f458b39aa08962",
|
| 37846 |
+
"model_b_conv_id": "005f0537c69647db9a937ad3cf6c2801",
|
| 37847 |
+
"inputs": {
|
| 37848 |
+
"prompt": "a car"
|
| 37849 |
+
},
|
| 37850 |
+
"model_a": "CogVideoX-5B",
|
| 37851 |
+
"model_b": "Mochi1",
|
| 37852 |
+
"vote_type": "leftvote",
|
| 37853 |
+
"winner": "model_a",
|
| 37854 |
+
"judge": "arena_user_10.16.17.80",
|
| 37855 |
+
"anony": true,
|
| 37856 |
+
"tstamp": 1738244684.4793
|
| 37857 |
+
},
|
| 37858 |
+
{
|
| 37859 |
+
"model_a_conv_id": "87718eba7f954f878d158161db6595ab",
|
| 37860 |
+
"model_b_conv_id": "9aab5f00e14941e5a4457ecdefc8c0fd",
|
| 37861 |
+
"inputs": {
|
| 37862 |
+
"prompt": "A panda drinking coffee in a cafe in Paris, black and white"
|
| 37863 |
+
},
|
| 37864 |
+
"model_a": "Mochi1",
|
| 37865 |
+
"model_b": "CogVideoX-5B",
|
| 37866 |
+
"vote_type": "leftvote",
|
| 37867 |
+
"winner": "model_a",
|
| 37868 |
+
"judge": "arena_user_10.16.17.80",
|
| 37869 |
+
"anony": true,
|
| 37870 |
+
"tstamp": 1738244694.3055
|
| 37871 |
+
},
|
| 37872 |
+
{
|
| 37873 |
+
"model_a_conv_id": "e373b38cf09c4a50b4856377aa2c48ca",
|
| 37874 |
+
"model_b_conv_id": "5a76c6454c64413f82c31e015baa91fb",
|
| 37875 |
+
"inputs": {
|
| 37876 |
+
"prompt": "a car slowing down to stop"
|
| 37877 |
+
},
|
| 37878 |
+
"model_a": "Mochi1",
|
| 37879 |
+
"model_b": "CogVideoX-5B",
|
| 37880 |
+
"vote_type": "rightvote",
|
| 37881 |
+
"winner": "model_b",
|
| 37882 |
+
"judge": "arena_user_10.16.46.168",
|
| 37883 |
+
"anony": true,
|
| 37884 |
+
"tstamp": 1738244704.8622
|
| 37885 |
}
|
| 37886 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:725c8b9c31176242913fee6715928e0a8c3faeedcba5daa1672a222a2161f550
|
| 3 |
+
size 88250
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 81355
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:afe6c975568a6d19d4c7b4ca86c4a12928b27145b93c6f932f223654f06c9ceb
|
| 3 |
size 81355
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
|
@@ -1,18 +1,18 @@
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
-
FLUX.1-dev,FLUX.1-dev,1133.
|
| 3 |
-
PlayGround V2.5,PlayGround V2.5,1115.
|
| 4 |
-
FLUX.1-schnell,FLUX.1-schnell,1091.
|
| 5 |
-
PlayGround V2,PlayGround V2,1071.
|
| 6 |
-
Kolors,Kolors,1053.
|
| 7 |
-
StableCascade,StableCascade,1041.
|
| 8 |
-
HunyuanDiT,HunyuanDiT,1023.
|
| 9 |
-
PixArtAlpha,PixArtAlpha,1019.
|
| 10 |
-
SDXL-Lightning,SDXL-Lightning,1018.
|
| 11 |
-
PixArtSigma,PixArtSigma,1017.
|
| 12 |
-
SD3,SD3,
|
| 13 |
-
AuraFlow,AuraFlow,
|
| 14 |
-
SDXL,SDXL,964.
|
| 15 |
-
SDXLTurbo,SDXLTurbo,912.
|
| 16 |
-
LCM(v1.5/XL),LCM(v1.5/XL),904.
|
| 17 |
-
OpenJourney,OpenJourney,831.
|
| 18 |
-
LCM,LCM,789.
|
|
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
FLUX.1-dev,FLUX.1-dev,1133.51320656307,1135.6106605853138,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 3 |
+
PlayGround V2.5,PlayGround V2.5,1115.5650664166171,1116.656560423584,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
| 4 |
+
FLUX.1-schnell,FLUX.1-schnell,1091.2263845021516,1097.8195526242403,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 5 |
+
PlayGround V2,PlayGround V2,1071.5024886363958,1071.314163888098,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
| 6 |
+
Kolors,Kolors,1053.3421877076214,1052.4074297605216,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
| 7 |
+
StableCascade,StableCascade,1041.7389350063136,1044.3826154433414,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
| 8 |
+
HunyuanDiT,HunyuanDiT,1023.0629845184011,1017.5528331262328,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
| 9 |
+
PixArtAlpha,PixArtAlpha,1019.6747531812322,1012.1134622168482,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
| 10 |
+
SDXL-Lightning,SDXL-Lightning,1018.6247821770202,1022.9053444075905,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
| 11 |
+
PixArtSigma,PixArtSigma,1017.9091275643414,1018.1018308191997,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
| 12 |
+
SD3,SD3,1010.9185635588934,1011.9582670583991,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
| 13 |
+
AuraFlow,AuraFlow,1000.6473559022509,997.3093798257966,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
| 14 |
+
SDXL,SDXL,964.3575463871532,966.2474951980506,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
| 15 |
+
SDXLTurbo,SDXLTurbo,912.9567286608586,911.3598127178495,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
| 16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.4652039963336,898.8456201267345,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
| 17 |
+
OpenJourney,OpenJourney,831.0181931921011,826.6770833292192,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
| 18 |
+
LCM,LCM,789.476492029242,804.4048353625417,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
|
@@ -1,16 +1,16 @@
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
-
CogVideoX-5B,CogVideoX-5B,
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
Mochi1,Mochi1,1104.
|
| 6 |
-
T2V-Turbo,T2V-Turbo,1057.
|
| 7 |
-
CogVideoX-2B,CogVideoX-2B,
|
| 8 |
-
AnimateDiff,AnimateDiff,
|
| 9 |
-
VideoCrafter2,VideoCrafter2,
|
| 10 |
-
Allegro,Allegro,
|
| 11 |
-
LTXVideo,LTXVideo,968.
|
| 12 |
-
LaVie,LaVie,
|
| 13 |
-
OpenSora,OpenSora,
|
| 14 |
-
OpenSora v1.2,OpenSora v1.2,
|
| 15 |
-
AnimateDiff Turbo,AnimateDiff Turbo,
|
| 16 |
-
ModelScope,ModelScope,
|
|
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
CogVideoX-5B,CogVideoX-5B,1158.015140037087,1154.482244262217,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 3 |
+
StableVideoDiffusion,StableVideoDiffusion,1119.4743099303432,1122.0570174876473,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
| 4 |
+
Pyramid Flow,Pyramid Flow,1109.5530804756415,1112.5241213182721,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
| 5 |
+
Mochi1,Mochi1,1104.4363165816096,1105.5206995717626,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
| 6 |
+
T2V-Turbo,T2V-Turbo,1057.8651235974799,1059.1983191890347,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
| 7 |
+
CogVideoX-2B,CogVideoX-2B,1049.051937893046,1047.4096122728752,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 8 |
+
AnimateDiff,AnimateDiff,1038.6583163447103,1039.4570307535914,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
| 9 |
+
VideoCrafter2,VideoCrafter2,1032.3141804376194,1032.676093890844,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
| 10 |
+
Allegro,Allegro,993.0540302426419,996.7276200816042,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
| 11 |
+
LTXVideo,LTXVideo,968.7030858293559,962.0542061213175,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
| 12 |
+
LaVie,LaVie,965.5910073484995,966.1766083145712,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
| 13 |
+
OpenSora,OpenSora,881.9642309092337,882.1876176582986,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 14 |
+
OpenSora v1.2,OpenSora v1.2,853.6334118642726,851.4677677123974,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,835.795070428639,834.4576004760767,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
| 16 |
+
ModelScope,ModelScope,831.89075807982,833.6034408894933,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|