mwatson-nvidia's picture
open comp
a6a33b0
|
Raw
History Blame
2.88 kB
metadata
title: AlpaSim Challenge 2026
colorFrom: green
colorTo: blue
sdk: docker
app_port: 7860
hf_oauth: true
hf_oauth_scopes:
  - email

AlpaSim Challenge 2026

This Docker Space serves a static landing page with an embedded Gradio app for:

  • team registration
  • signed-in participant registration status
  • public PAI and nuPlan leaderboards
  • a reviewer-only Review tab for approving or rejecting pending registrations

Participants connect their Hugging Face account from the registration page. The Space uses the signed-in Hugging Face profile to capture the captain username, stable Hugging Face sub, and email when available.

The Space must define these secrets:

ALPASIM_API_BASE_URL
ALPASIM_REGISTRATION_SECRET

For the AWS H100 prototype, ALPASIM_API_BASE_URL should point at the us-east-1 API Gateway endpoint, for example:

https://<api-id>.execute-api.us-east-1.amazonaws.com

Do not commit the registration secret to this repository.

Tabs

Registration lets a signed-in captain submit a team request. Optional fields: additional submitter Hugging Face usernames, credited contributors, organization, country/region, and notes. The form is hidden once the signed-in captain has a pending, approved, or registered team. After approval, listed additional submitters can connect Hugging Face in this tab and click Join Team to bind their stable Hugging Face sub to the approved team.

PAI Leaderboard and nuPlan Leaderboard load public leaderboard data from the backend.

Review is hidden unless the signed-in Hugging Face user's stable sub exists as an active reviewer or admin in the alpasim-reviewers DynamoDB table. It lists registrations by status, shows full registration details, and supports approve/reject actions. Approval grants captain access and leaves any additional submitter usernames as claimable post-approval invitations.

Documentation

Capability score computation is documented at:

https://ln2697.github.io/navhard-leaderboard-2/docs/

Soft Open Notes

The nuPlan track currently uses a provisional dataset. Teams may submit during this period to validate the workflow and understand the evaluation process. When the updated nuPlan data is available, organizers will clear the nuPlan leaderboard and resubmit each team's best submission.

The PAI track currently includes a subset of the final scenes. Additional scenes will be added later in the competition.

Bugs, questions, and competition discussions should be raised on the public AlpaSim repository:

https://github.com/NVlabs/alpasim

Prizes

Each track will award two NVIDIA DGX prizes:

  • PAI-AV track: two NVIDIA DGX prizes for the top two teams.
  • nuPlan track: two NVIDIA DGX prizes for the top two teams.

The app serves the landing page from FastAPI at / and mounts Gradio at /gradio.