MINGYISU commited on
Commit
83adc5e
·
verified ·
1 Parent(s): cd2263d

Update utils.py

Browse files
Files changed (1) hide show
  1. utils.py +3 -2
utils.py CHANGED
@@ -117,8 +117,9 @@ SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction
117
  Please email us or leave a simple message (simply @ us) in the PR to indicate that you are ready to merge your PR. We will not merge your PR without informing us since we might think you are still editing and not yet ready to merge.
118
  We will review your submission and update the leaderboard accordingly. \n\n
119
  ## Special Instructions for submitting to MMEB Image (Previously MMEB-V1) Leaderboard
120
- We understand that some researchers want to exclusively submit to the Image leaderboard. To do so, just run the 36 image datasets only and simply ignore the other datasets. The leaderboard will automatically assign a 0 to the missing datasets.
121
- We might be able to hide your model from the other leaderboards in the next leaderboard updates, but for now your model might have a lower rank on the overall leaderboard.
 
122
  We highly recommend joining our [discord server](https://discord.gg/njyKubdtry), which provides a convenient way to stay informed with latest updates, or share any feedback you have for improving the leaderboard experience. We appreciate your contributions to the MMEB community!
123
  """
124
 
 
117
  Please email us or leave a simple message (simply @ us) in the PR to indicate that you are ready to merge your PR. We will not merge your PR without informing us since we might think you are still editing and not yet ready to merge.
118
  We will review your submission and update the leaderboard accordingly. \n\n
119
  ## Special Instructions for submitting to MMEB Image (Previously MMEB-V1) Leaderboard
120
+ We understand that some researchers want to exclusively submit to the Image leaderboard, but unfortunately our current code doesn't support that. To do so, simply run the 36 image datasets only and ignore the other datasets.
121
+ The leaderboard will automatically assign a 0 to the missing datasets.
122
+ We might be able to hide your model from the other leaderboards in the next leaderboard updates, but for now your model will be shown on all leaderboards and might have a lower rank.
123
  We highly recommend joining our [discord server](https://discord.gg/njyKubdtry), which provides a convenient way to stay informed with latest updates, or share any feedback you have for improving the leaderboard experience. We appreciate your contributions to the MMEB community!
124
  """
125