| --- |
| title: CADGenBench eval image (paused, image-only Space) |
| colorFrom: gray |
| colorTo: gray |
| sdk: docker |
| pinned: false |
| license: apache-2.0 |
| short_description: Image-only Space. Holds the GPU eval image for HF Jobs. |
| --- |
| |
| # cadgenbench-eval-gpu |
|
|
| **This Space is intentionally Paused. It does not run an app.** |
|
|
| It exists only to host the GPU Docker image that the |
| [CADGenBench leaderboard](https://huggingface.co/spaces/HuggingAI4Engineering/cadgenbench-leaderboard) |
| pulls via `hf jobs run --image hf.co/spaces/HuggingAI4Engineering/cadgenbench-eval-gpu` |
| each time a submission lands. Eval runs in a per-submission HF Job |
| on `a10g-large`; this Space is just the storage backend for the |
| image (the same role GHCR or Docker Hub would play in another setup). |
|
|
| The Dockerfile + `eval_job.py` here are the entire source of truth |
| for what runs inside each eval. Browsing them is supported; opening |
| the live URL is not (the runtime is paused on purpose, the image is |
| still cached and pullable by Jobs). |
|
|
| Design + integration details: |
| [`space-setup/jobs-migration.md`](https://github.com/huggingface/cadgenbench) |
| (in the umbrella `cadgenbench` working tree). The leaderboard Space's |
| worker dispatches `python /opt/eval_job.py <submission_id> <zip_url>` |
| against this image on `a10g-large` and polls for completion. |
|
|
| ## Image contents |
|
|
| - `nvidia/cuda:12.4.1-runtime-ubuntu22.04` base. |
| - Python 3.12 via deadsnakes. |
| - Apt runtime deps for OCP / build123d / VTK (shared with the |
| leaderboard Dockerfile) plus `libegl1 libegl-mesa0` for the EGL |
| context. |
| - `cadgenbench @ git+https://github.com/huggingface/cadgenbench@<sha>`, |
| controlled via `ARG CADGENBENCH_SHA` (pre-v1 defaults to `main`; pin a SHA |
| at release). This installs cadgenbench's Python dependencies, including |
| Open3D for rigid alignment. |
| - `vtk-egl` swapped in for the PyPI `vtk` wheel (same swap shape as |
| the leaderboard's `vtk-osmesa`; the GPU counterpart). PyVista |
| picks up whichever `vtk` dist is installed; no cadgenbench code |
| change needed. |
| - `/opt/eval_job.py` entrypoint script. |
|
|
