Spaces:

---

TIGER-Lab

/

MMEB-Leaderboard

like 119

Running on CPU Upgrade

Hi @Alex0501 , thanks for the reminder!
I just noticed this "Space Paused You've reached your hardware quota limit across the Spaces of this organization!"
We will fix this soon.

Hi @ziyjiang and TIGER-Lab team,

Thanks for looking into this. It seems that the MMEB leaderboard Space has still been paused for around 11 days due to the hardware quota limit.

Since MMEB is an important open benchmark for the multimodal embedding community, many users rely on the leaderboard for tracking results, comparing models, and verifying submissions. Could you please share whether there is an estimated timeline for restoring the Space, or if there is any temporary mirror / alternative way to access the latest leaderboard results?

Thanks a lot for maintaining this benchmark and for your help!

An update here: while we are still working to fix the original space, we have provided a duplicate space (https://huggingface.co/spaces/VLM2Vec/MMEB-Leaderboard) to unblock everyone. Thanks!

The original one is also back online!
Going forward, we will continue to maintain the Tiger-Lab version as the main leaderboard and use the other one as a backup.