README.md

metadata

title: MAP AI Benchmark
colorFrom: green
colorTo: yellow
sdk: static
pinned: false

Multimodal Accessibility Planning (MAP) AI Benchmark

MAP evaluates multimodal AI systems as assistants for users with accessibility requirements when planning visits to real places. The benchmark starts with places in Zurich and focuses on evidence-backed accessibility features such as step-free entrance, toilet access, sensory accessibility provisions, and location information.

Challenge Workshop Benchmark

Current Public Pages

• Challenge: public challenge overview and phase-one entrant information.
• Workshop: workshop agenda, diversity and inclusion considerations, and organiser information.
• Benchmark: evaluation protocol, public materials, and paper placeholder.

Models and Datasets

• Models: Coming soon.
• Datasets: Coming soon.

Submission and leaderboard will be added shortly.