---
tags:
  - autonomous-driving
  - reward-model
  - text-classification
  - vision-language
---

# AlpaJudge

AlpaJudge is a family of learned judges for evaluating autonomous-driving reasoning. This
repository provides one reference-based checkpoint and one reference-free checkpoint.

### License/Terms of Use:

**Model weights:** The model weights are released under the [OpenMDW-1.1](https://openmdw.ai/license/1-1/) license.

**Source code:** Apache License 2.0, as provided in the [AlpaJudge GitHub repository](https://github.com/NVlabs/alpajudge).

## Checkpoints

| Variant | Folder | Inputs | Output |
| --- | --- | --- | --- |
| AlpaJudge-RB | [`reference-based/`](./reference-based) | Question, reference answer, and candidate answer; no images | One alignment probability in `[0, 1]` |
| AlpaJudge-RF | [`reference-free/`](./reference-free) | Front-wide/front-tele frames, ego meta-action history and future, and a candidate rationale | Five rubric probabilities plus the aggregated action, component, and overall scores |

Both variants are available from
[`nvidia/alpajudge`](https://huggingface.co/nvidia/alpajudge) in the subfolders shown above.

## Download

Authenticate with an account that can access the repository, then download only the variant you
need:

```python
from pathlib import Path

from huggingface_hub import snapshot_download

variant = "reference-based"  # or "reference-free"
repo_dir = Path(
    snapshot_download(
        "nvidia/alpajudge",
        allow_patterns=f"{variant}/*",
    )
)
checkpoint = repo_dir / variant
```

Use the `alpajudge` inference package to load either subfolder. See the
[usage guide](https://github.com/NVlabs/alpajudge#readme) for setup, complete RB and RF examples,
input contracts, score definitions, and limitations.

## Support

📣 **Usage questions**: post on the [Alpamayo NV Developer Forum](https://forums.developer.nvidia.com/c/autonomous-vehicles/alpamayo/766).

🐛 **Code bugs / documentation issues / feature requests**: file a GitHub issue using the appropriate template (Bug report, Documentation request, or Feature request) at https://github.com/NVlabs/alpajudge/issues/new/choose . The relevant NVIDIA responder is auto-assigned.

🚨 **Security vulnerabilities**: please use [NVIDIA's Vulnerability Disclosure Program](https://app.intigriti.com/programs/nvidia/nvidiavdp/detail). Do not file public issues.