File size: 2,400 Bytes
7bf22a7 609036a bf78544 609036a 7bf22a7 44da7b2 7bf22a7 bf78544 cb3d9f5 80933c2 cb3d9f5 80933c2 7b0c026 80933c2 cb3d9f5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 | ---
tags:
- autonomous-driving
- reward-model
- text-classification
- vision-language
---
# AlpaJudge
AlpaJudge is a family of learned judges for evaluating autonomous-driving reasoning. This
repository provides one reference-based checkpoint and one reference-free checkpoint.
### License/Terms of Use:
**Model weights:** The model weights are released under the [OpenMDW-1.1](https://openmdw.ai/license/1-1/) license.
**Source code:** Apache License 2.0, as provided in the [AlpaJudge GitHub repository](https://github.com/NVlabs/alpajudge).
## Checkpoints
| Variant | Folder | Inputs | Output |
| --- | --- | --- | --- |
| AlpaJudge-RB | [`reference-based/`](./reference-based) | Question, reference answer, and candidate answer; no images | One alignment probability in `[0, 1]` |
| AlpaJudge-RF | [`reference-free/`](./reference-free) | Front-wide/front-tele frames, ego meta-action history and future, and a candidate rationale | Five rubric probabilities plus the aggregated action, component, and overall scores |
Both variants are available from
[`nvidia/alpajudge`](https://huggingface.co/nvidia/alpajudge) in the subfolders shown above.
## Download
Authenticate with an account that can access the repository, then download only the variant you
need:
```python
from pathlib import Path
from huggingface_hub import snapshot_download
variant = "reference-based" # or "reference-free"
repo_dir = Path(
snapshot_download(
"nvidia/alpajudge",
allow_patterns=f"{variant}/*",
)
)
checkpoint = repo_dir / variant
```
Use the `alpajudge` inference package to load either subfolder. See the
[usage guide](https://github.com/NVlabs/alpajudge#readme) for setup, complete RB and RF examples,
input contracts, score definitions, and limitations.
## Support
📣 **Usage questions**: post on the [Alpamayo NV Developer Forum](https://forums.developer.nvidia.com/c/autonomous-vehicles/alpamayo/766).
🐛 **Code bugs / documentation issues / feature requests**: file a GitHub issue using the appropriate template (Bug report, Documentation request, or Feature request) at https://github.com/NVlabs/alpajudge/issues/new/choose . The relevant NVIDIA responder is auto-assigned.
🚨 **Security vulnerabilities**: please use [NVIDIA's Vulnerability Disclosure Program](https://app.intigriti.com/programs/nvidia/nvidiavdp/detail). Do not file public issues.
|