Spaces:
Running
on
Zero
Running
on
Zero
Commit
·
3027d57
1
Parent(s):
0bd4963
Auto Daily Leaderboard udpate Sat Feb 22 12:00:30 PM EST 2025
Browse files- arena_elo/results/20250221/clean_battle_video_generation.json +0 -0
- arena_elo/results/20250221/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20250221/video_generation_leaderboard.csv +16 -0
- arena_elo/results/20250222/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20250222/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20250222/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +98 -0
- arena_elo/results/latest/clean_battle_video_generation.json +70 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
- arena_elo/results/latest/video_generation_leaderboard.csv +15 -15
arena_elo/results/20250221/clean_battle_video_generation.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
arena_elo/results/20250221/elo_results_video_generation.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c11478464c8e84d0ae67c80654332e9b6bd50a4e4a2ce1749f56f557607bacc
|
| 3 |
+
size 81355
|
arena_elo/results/20250221/video_generation_leaderboard.csv
ADDED
|
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
CogVideoX-5B,CogVideoX-5B,1127.1691949732046,1129.501093504523,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 3 |
+
StableVideoDiffusion,StableVideoDiffusion,1121.4592351113392,1121.452777045595,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
| 4 |
+
Mochi1,Mochi1,1118.227248898122,1117.9933875975128,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
| 5 |
+
Pyramid Flow,Pyramid Flow,1102.233723190339,1104.2623080647986,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
| 6 |
+
T2V-Turbo,T2V-Turbo,1057.2085870600984,1057.6362985792366,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
| 7 |
+
CogVideoX-2B,CogVideoX-2B,1054.4216981424986,1052.773965891591,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 8 |
+
AnimateDiff,AnimateDiff,1042.837635570472,1042.1227858053005,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
| 9 |
+
VideoCrafter2,VideoCrafter2,1035.2477228529008,1034.6644915179827,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
| 10 |
+
Allegro,Allegro,986.3544288446327,988.9926644270606,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
| 11 |
+
LaVie,LaVie,968.193018888931,967.7315625513834,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
| 12 |
+
LTXVideo,LTXVideo,953.4206511434369,953.9381798885538,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
| 13 |
+
OpenSora,OpenSora,884.5884471201819,883.8548876527029,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 14 |
+
OpenSora v1.2,OpenSora v1.2,876.6882473406137,873.9640080860785,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,837.497711048029,835.9123319232042,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
| 16 |
+
ModelScope,ModelScope,834.452449815201,835.1992574644753,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
arena_elo/results/20250222/clean_battle_t2i_generation.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
arena_elo/results/20250222/elo_results_t2i_generation.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a26cb552b05875c99717de979cfa3fd9c3321e1c379ae96145eadba6b6765c64
|
| 3 |
+
size 88249
|
arena_elo/results/20250222/t2i_generation_leaderboard.csv
ADDED
|
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
FLUX.1-dev,FLUX.1-dev,1138.691356879598,1136.4764318577681,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 3 |
+
PlayGround V2.5,PlayGround V2.5,1116.1991681110078,1118.784077071998,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
| 4 |
+
FLUX.1-schnell,FLUX.1-schnell,1095.822777750145,1099.5856372809617,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 5 |
+
PlayGround V2,PlayGround V2,1071.1093949978563,1071.391787719478,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
| 6 |
+
Kolors,Kolors,1061.2534653624618,1060.130644170473,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
| 7 |
+
StableCascade,StableCascade,1042.8373382955986,1045.6328610006767,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
| 8 |
+
HunyuanDiT,HunyuanDiT,1019.768795000682,1014.850927483953,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
| 9 |
+
PixArtAlpha,PixArtAlpha,1018.6221737259949,1011.5901174270059,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
| 10 |
+
PixArtSigma,PixArtSigma,1016.6439695770163,1017.1146909604512,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
| 11 |
+
SDXL-Lightning,SDXL-Lightning,1015.0604879932714,1019.9806507907191,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
| 12 |
+
SD3,SD3,1007.7758085839664,1009.0690486226512,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
| 13 |
+
AuraFlow,AuraFlow,994.653821566646,991.9142604606984,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
| 14 |
+
SDXL,SDXL,964.7623221881728,966.7046313769139,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
| 15 |
+
SDXLTurbo,SDXLTurbo,912.9197350153063,911.6426355668568,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
| 16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.034841254071,898.7945738267998,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
| 17 |
+
OpenJourney,OpenJourney,830.6741046111756,826.6875182359053,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
| 18 |
+
LCM,LCM,789.1704390870377,804.459525391065,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
|
@@ -118868,5 +118868,103 @@
|
|
| 118868 |
"judge": "arena_user_10.16.1.166",
|
| 118869 |
"anony": true,
|
| 118870 |
"tstamp": 1740151830.2177
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 118871 |
}
|
| 118872 |
]
|
|
|
|
| 118868 |
"judge": "arena_user_10.16.1.166",
|
| 118869 |
"anony": true,
|
| 118870 |
"tstamp": 1740151830.2177
|
| 118871 |
+
},
|
| 118872 |
+
{
|
| 118873 |
+
"model_a_conv_id": "f36610afcdfa450192b41df0e3f6fa23",
|
| 118874 |
+
"model_b_conv_id": "dda2da2a708341c9aa28b9305371c633",
|
| 118875 |
+
"inputs": {
|
| 118876 |
+
"prompt": "A storefront with 'Hello World' written on it."
|
| 118877 |
+
},
|
| 118878 |
+
"model_a": "SD3",
|
| 118879 |
+
"model_b": "SDXL-Lightning",
|
| 118880 |
+
"vote_type": "leftvote",
|
| 118881 |
+
"winner": "model_a",
|
| 118882 |
+
"judge": "arena_user_10.16.1.166",
|
| 118883 |
+
"anony": true,
|
| 118884 |
+
"tstamp": 1740160017.0795
|
| 118885 |
+
},
|
| 118886 |
+
{
|
| 118887 |
+
"model_a_conv_id": "510753bd440346b8817db9f5b7e74594",
|
| 118888 |
+
"model_b_conv_id": "2661e0aa05214896ae82ccc15505015e",
|
| 118889 |
+
"inputs": {
|
| 118890 |
+
"prompt": "A pizza on the right of a suitcase."
|
| 118891 |
+
},
|
| 118892 |
+
"model_a": "SD3",
|
| 118893 |
+
"model_b": "AuraFlow",
|
| 118894 |
+
"vote_type": "rightvote",
|
| 118895 |
+
"winner": "model_b",
|
| 118896 |
+
"judge": "arena_user_10.16.41.172",
|
| 118897 |
+
"anony": true,
|
| 118898 |
+
"tstamp": 1740160035.8293
|
| 118899 |
+
},
|
| 118900 |
+
{
|
| 118901 |
+
"model_a_conv_id": "e74ddd0600f44b469e25057c6333eccc",
|
| 118902 |
+
"model_b_conv_id": "a37218f0f36c4ae3b7c4d82273b77e80",
|
| 118903 |
+
"inputs": {
|
| 118904 |
+
"prompt": "photograph of black hole"
|
| 118905 |
+
},
|
| 118906 |
+
"model_a": "HunyuanDiT",
|
| 118907 |
+
"model_b": "FLUX.1-schnell",
|
| 118908 |
+
"vote_type": "tievote",
|
| 118909 |
+
"winner": "tie",
|
| 118910 |
+
"judge": "arena_user_10.16.17.134",
|
| 118911 |
+
"anony": true,
|
| 118912 |
+
"tstamp": 1740160063.3577
|
| 118913 |
+
},
|
| 118914 |
+
{
|
| 118915 |
+
"model_a_conv_id": "5e4d0a3acaa1491a8e1f5fe04b686525",
|
| 118916 |
+
"model_b_conv_id": "754ae0edcfc547c185db947cde94a34b",
|
| 118917 |
+
"inputs": {
|
| 118918 |
+
"prompt": "checkerboard "
|
| 118919 |
+
},
|
| 118920 |
+
"model_a": "OpenJourney",
|
| 118921 |
+
"model_b": "FLUX.1-schnell",
|
| 118922 |
+
"vote_type": "bothbad_vote",
|
| 118923 |
+
"winner": "tie (bothbad)",
|
| 118924 |
+
"judge": "arena_user_10.16.41.172",
|
| 118925 |
+
"anony": true,
|
| 118926 |
+
"tstamp": 1740160080.8324
|
| 118927 |
+
},
|
| 118928 |
+
{
|
| 118929 |
+
"model_a_conv_id": "e976e06a6798414c888717d92f17e591",
|
| 118930 |
+
"model_b_conv_id": "0505c0addff4490a89cdc8284995de5c",
|
| 118931 |
+
"inputs": {
|
| 118932 |
+
"prompt": "A wine glass on top of a dog."
|
| 118933 |
+
},
|
| 118934 |
+
"model_a": "SDXL",
|
| 118935 |
+
"model_b": "Kolors",
|
| 118936 |
+
"vote_type": "bothbad_vote",
|
| 118937 |
+
"winner": "tie (bothbad)",
|
| 118938 |
+
"judge": "arena_user_10.16.39.39",
|
| 118939 |
+
"anony": true,
|
| 118940 |
+
"tstamp": 1740160103.7374
|
| 118941 |
+
},
|
| 118942 |
+
{
|
| 118943 |
+
"model_a_conv_id": "e848ad7e756e4373b76d24058daff0ee",
|
| 118944 |
+
"model_b_conv_id": "8c74f44408274cb7b16abcc24ef038d9",
|
| 118945 |
+
"inputs": {
|
| 118946 |
+
"prompt": "photograph of man on a bicycle holding a newspaper"
|
| 118947 |
+
},
|
| 118948 |
+
"model_a": "AuraFlow",
|
| 118949 |
+
"model_b": "SDXL-Lightning",
|
| 118950 |
+
"vote_type": "leftvote",
|
| 118951 |
+
"winner": "model_a",
|
| 118952 |
+
"judge": "arena_user_10.16.17.134",
|
| 118953 |
+
"anony": true,
|
| 118954 |
+
"tstamp": 1740174146.2527
|
| 118955 |
+
},
|
| 118956 |
+
{
|
| 118957 |
+
"model_a_conv_id": "d7265be0cb064f6bb507432f1041c703",
|
| 118958 |
+
"model_b_conv_id": "076ed8bfe9894eaf8b1897b3016e54cd",
|
| 118959 |
+
"inputs": {
|
| 118960 |
+
"prompt": "Motorcyclis in blue white and red clothing with matching colored motorcycle ."
|
| 118961 |
+
},
|
| 118962 |
+
"model_a": "SD3",
|
| 118963 |
+
"model_b": "StableCascade",
|
| 118964 |
+
"vote_type": "rightvote",
|
| 118965 |
+
"winner": "model_b",
|
| 118966 |
+
"judge": "arena_user_10.16.17.134",
|
| 118967 |
+
"anony": true,
|
| 118968 |
+
"tstamp": 1740225921.3953
|
| 118969 |
}
|
| 118970 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
|
@@ -39898,5 +39898,75 @@
|
|
| 39898 |
"judge": "arena_user_10.20.34.20",
|
| 39899 |
"anony": true,
|
| 39900 |
"tstamp": 1740111034.16
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39901 |
}
|
| 39902 |
]
|
|
|
|
| 39898 |
"judge": "arena_user_10.20.34.20",
|
| 39899 |
"anony": true,
|
| 39900 |
"tstamp": 1740111034.16
|
| 39901 |
+
},
|
| 39902 |
+
{
|
| 39903 |
+
"model_a_conv_id": "223aeb7402f74d9f9f3d959331563364",
|
| 39904 |
+
"model_b_conv_id": "4143f3addb55432091104a7e8ecf6cd2",
|
| 39905 |
+
"inputs": {
|
| 39906 |
+
"prompt": "pharmacy"
|
| 39907 |
+
},
|
| 39908 |
+
"model_a": "CogVideoX-5B",
|
| 39909 |
+
"model_b": "OpenSora v1.2",
|
| 39910 |
+
"vote_type": "leftvote",
|
| 39911 |
+
"winner": "model_a",
|
| 39912 |
+
"judge": "arena_user_10.16.41.172",
|
| 39913 |
+
"anony": true,
|
| 39914 |
+
"tstamp": 1740161276.9349
|
| 39915 |
+
},
|
| 39916 |
+
{
|
| 39917 |
+
"model_a_conv_id": "31d71281b252482e8a49b49ff433400a",
|
| 39918 |
+
"model_b_conv_id": "66d25ee5690a4e058a6c4cb09d0969b2",
|
| 39919 |
+
"inputs": {
|
| 39920 |
+
"prompt": "a cake and a vase"
|
| 39921 |
+
},
|
| 39922 |
+
"model_a": "OpenSora v1.2",
|
| 39923 |
+
"model_b": "StableVideoDiffusion",
|
| 39924 |
+
"vote_type": "bothbad_vote",
|
| 39925 |
+
"winner": "tie (bothbad)",
|
| 39926 |
+
"judge": "arena_user_10.16.41.172",
|
| 39927 |
+
"anony": true,
|
| 39928 |
+
"tstamp": 1740161326.6749
|
| 39929 |
+
},
|
| 39930 |
+
{
|
| 39931 |
+
"model_a_conv_id": "f9df48c3f164455398d4190e20f75bdc",
|
| 39932 |
+
"model_b_conv_id": "7a29ce264ebd4eab861d9a3c7e6ebe30",
|
| 39933 |
+
"inputs": {
|
| 39934 |
+
"prompt": "A cute happy Corgi playing in park, sunset"
|
| 39935 |
+
},
|
| 39936 |
+
"model_a": "CogVideoX-2B",
|
| 39937 |
+
"model_b": "LTXVideo",
|
| 39938 |
+
"vote_type": "rightvote",
|
| 39939 |
+
"winner": "model_b",
|
| 39940 |
+
"judge": "arena_user_10.16.39.39",
|
| 39941 |
+
"anony": true,
|
| 39942 |
+
"tstamp": 1740161360.0217
|
| 39943 |
+
},
|
| 39944 |
+
{
|
| 39945 |
+
"model_a_conv_id": "94aa1ba99dc84f31a4371a4fb87e979c",
|
| 39946 |
+
"model_b_conv_id": "cd1733db38134b4c8ba31384cb21689f",
|
| 39947 |
+
"inputs": {
|
| 39948 |
+
"prompt": "A couple in formal evening wear going home get caught in a heavy downpour with umbrellas, pan left"
|
| 39949 |
+
},
|
| 39950 |
+
"model_a": "Allegro",
|
| 39951 |
+
"model_b": "StableVideoDiffusion",
|
| 39952 |
+
"vote_type": "rightvote",
|
| 39953 |
+
"winner": "model_b",
|
| 39954 |
+
"judge": "arena_user_10.20.28.164",
|
| 39955 |
+
"anony": true,
|
| 39956 |
+
"tstamp": 1740164928.4957
|
| 39957 |
+
},
|
| 39958 |
+
{
|
| 39959 |
+
"model_a_conv_id": "d1bedf1abd1745d18620f79582381497",
|
| 39960 |
+
"model_b_conv_id": "ff2f2227707a48b09f34db6a6378efb2",
|
| 39961 |
+
"inputs": {
|
| 39962 |
+
"prompt": "a giraffe running to join a herd of its kind"
|
| 39963 |
+
},
|
| 39964 |
+
"model_a": "Allegro",
|
| 39965 |
+
"model_b": "OpenSora v1.2",
|
| 39966 |
+
"vote_type": "tievote",
|
| 39967 |
+
"winner": "tie",
|
| 39968 |
+
"judge": "arena_user_10.20.28.164",
|
| 39969 |
+
"anony": true,
|
| 39970 |
+
"tstamp": 1740165007.1521
|
| 39971 |
}
|
| 39972 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 88249
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a26cb552b05875c99717de979cfa3fd9c3321e1c379ae96145eadba6b6765c64
|
| 3 |
size 88249
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 81355
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c11478464c8e84d0ae67c80654332e9b6bd50a4e4a2ce1749f56f557607bacc
|
| 3 |
size 81355
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
|
@@ -1,18 +1,18 @@
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
-
FLUX.1-dev,FLUX.1-dev,1138.
|
| 3 |
-
PlayGround V2.5,PlayGround V2.5,1116.
|
| 4 |
-
FLUX.1-schnell,FLUX.1-schnell,
|
| 5 |
-
PlayGround V2,PlayGround V2,1071.
|
| 6 |
-
Kolors,Kolors,1061.
|
| 7 |
-
StableCascade,StableCascade,1042.
|
| 8 |
-
HunyuanDiT,HunyuanDiT,1019.
|
| 9 |
-
PixArtAlpha,PixArtAlpha,1018.
|
| 10 |
-
PixArtSigma,PixArtSigma,1016.
|
| 11 |
-
SDXL-Lightning,SDXL-Lightning,1015.
|
| 12 |
-
SD3,SD3,
|
| 13 |
-
AuraFlow,AuraFlow,
|
| 14 |
-
SDXL,SDXL,964.
|
| 15 |
-
SDXLTurbo,SDXLTurbo,912.
|
| 16 |
-
LCM(v1.5/XL),LCM(v1.5/XL),904.
|
| 17 |
-
OpenJourney,OpenJourney,830.
|
| 18 |
-
LCM,LCM,789.
|
|
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
FLUX.1-dev,FLUX.1-dev,1138.691356879598,1136.4764318577681,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 3 |
+
PlayGround V2.5,PlayGround V2.5,1116.1991681110078,1118.784077071998,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
| 4 |
+
FLUX.1-schnell,FLUX.1-schnell,1095.822777750145,1099.5856372809617,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 5 |
+
PlayGround V2,PlayGround V2,1071.1093949978563,1071.391787719478,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
| 6 |
+
Kolors,Kolors,1061.2534653624618,1060.130644170473,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
| 7 |
+
StableCascade,StableCascade,1042.8373382955986,1045.6328610006767,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
| 8 |
+
HunyuanDiT,HunyuanDiT,1019.768795000682,1014.850927483953,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
| 9 |
+
PixArtAlpha,PixArtAlpha,1018.6221737259949,1011.5901174270059,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
| 10 |
+
PixArtSigma,PixArtSigma,1016.6439695770163,1017.1146909604512,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
| 11 |
+
SDXL-Lightning,SDXL-Lightning,1015.0604879932714,1019.9806507907191,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
| 12 |
+
SD3,SD3,1007.7758085839664,1009.0690486226512,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
| 13 |
+
AuraFlow,AuraFlow,994.653821566646,991.9142604606984,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
| 14 |
+
SDXL,SDXL,964.7623221881728,966.7046313769139,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
| 15 |
+
SDXLTurbo,SDXLTurbo,912.9197350153063,911.6426355668568,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
| 16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.034841254071,898.7945738267998,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
| 17 |
+
OpenJourney,OpenJourney,830.6741046111756,826.6875182359053,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
| 18 |
+
LCM,LCM,789.1704390870377,804.459525391065,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
|
@@ -1,16 +1,16 @@
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
-
CogVideoX-5B,CogVideoX-5B,
|
| 3 |
-
StableVideoDiffusion,StableVideoDiffusion,1121.
|
| 4 |
-
Mochi1,Mochi1,1118.
|
| 5 |
-
Pyramid Flow,Pyramid Flow,1102.
|
| 6 |
-
T2V-Turbo,T2V-Turbo,1057.
|
| 7 |
-
CogVideoX-2B,CogVideoX-2B,
|
| 8 |
-
AnimateDiff,AnimateDiff,
|
| 9 |
-
VideoCrafter2,VideoCrafter2,1035.
|
| 10 |
-
Allegro,Allegro,
|
| 11 |
-
LaVie,LaVie,968.
|
| 12 |
-
LTXVideo,LTXVideo,
|
| 13 |
-
OpenSora,OpenSora,884.
|
| 14 |
-
OpenSora v1.2,OpenSora v1.2,876.
|
| 15 |
-
AnimateDiff Turbo,AnimateDiff Turbo,837.
|
| 16 |
-
ModelScope,ModelScope,834.
|
|
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
CogVideoX-5B,CogVideoX-5B,1127.1691949732046,1129.501093504523,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 3 |
+
StableVideoDiffusion,StableVideoDiffusion,1121.4592351113392,1121.452777045595,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
| 4 |
+
Mochi1,Mochi1,1118.227248898122,1117.9933875975128,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
| 5 |
+
Pyramid Flow,Pyramid Flow,1102.233723190339,1104.2623080647986,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
| 6 |
+
T2V-Turbo,T2V-Turbo,1057.2085870600984,1057.6362985792366,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
| 7 |
+
CogVideoX-2B,CogVideoX-2B,1054.4216981424986,1052.773965891591,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 8 |
+
AnimateDiff,AnimateDiff,1042.837635570472,1042.1227858053005,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
| 9 |
+
VideoCrafter2,VideoCrafter2,1035.2477228529008,1034.6644915179827,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
| 10 |
+
Allegro,Allegro,986.3544288446327,988.9926644270606,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
| 11 |
+
LaVie,LaVie,968.193018888931,967.7315625513834,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
| 12 |
+
LTXVideo,LTXVideo,953.4206511434369,953.9381798885538,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
| 13 |
+
OpenSora,OpenSora,884.5884471201819,883.8548876527029,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 14 |
+
OpenSora v1.2,OpenSora v1.2,876.6882473406137,873.9640080860785,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,837.497711048029,835.9123319232042,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
| 16 |
+
ModelScope,ModelScope,834.452449815201,835.1992574644753,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|