Multimodal benchmarks that test various aspects of LLMs, VLMs, LMMs
-
Multimodal Clembench
🏆3Explore and compare multimodal models with interactive leaderboards and plots
-
SEED-Bench Leaderboard
🏆85Submit model evaluation results to leaderboard
-
MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
Paper • 2311.16502 • Published • 40 -
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
Paper • 2409.02813 • Published • 33