Animhaven/cuda-runtime

AnimHaven CUDA Runtime

NVIDIA CUDA Toolkit + cuDNN runtime DLLs for the AnimHaven app family (AnimStart, AnimRoom). Distributed separately from the application installers so the base download stays small (~150 MB) and only NVIDIA-GPU users pull these ~2.85 GB of native libraries on demand.

---

What's in this repo

A flat directory of Windows .dll files comprising:

Family	Files	Approx. size
CUDA Toolkit	cublas64_12.dll, cublasLt64_12.dll, cudart64_12.dll	~548 MB
cuDNN	cudnn*.dll (engines, graph, ops, heuristic)	~947 MB
CUDA Math	cufft64_11.dll, cufftw64_11.dll, curand64_10.dll	~350 MB
NVRTC	nvJitLink_120_0.dll, nvrtc*.dll	~262 MB
CUDA engine bindings	ggml-cuda.dll (from llama.cpp build), onnxruntime_providers_cuda.dll	~741 MB
Total	~20 files	~2.85 GB

All files are NVIDIA's redistributable binaries vendored from the CUDA Toolkit installer + cuDNN release. No modifications.

---

Usage

This repo is consumed by the in-app installer — you typically don't download it directly. AnimStart's SetupWizard ("GPU acceleration" step) and Settings → Advanced → "GPU acceleration" both pull these files via HuggingFace LFS into <APPDATA>/AnimHaven/cuda_runtime/, verify SHA256, and register the directory with the Windows DLL loader via AddDllDirectoryW.

The manifest (file paths + sizes + SHA256) is baked into the AnimStart binary at compile time via include_str!("anim-shared/cuda-runtime-manifest.json"), so the installer has zero network round-trips on top of the file downloads themselves.

Direct download (advanced)

If you need to manually populate cuda_runtime/, e.g. for offline provisioning of a kiosk machine, clone the repo with Git LFS:

git lfs install
git clone https://huggingface.co/Animhaven/cuda-runtime
# Copy contents of cuda-runtime/ to %APPDATA%/AnimHaven/cuda_runtime/

---

License

The DLLs in this repo are NVIDIA software, redistributed under their respective EULAs:

• CUDA Toolkit components (cublas*.dll, cudart*.dll, cufft*.dll, curand*.dll, nvJitLink*.dll, nvrtc*.dll) — covered by the NVIDIA CUDA Toolkit End User License Agreement.
• cuDNN components (cudnn*.dll) — covered by the NVIDIA cuDNN Software License Agreement.
• ggml-cuda.dll — derived from llama.cpp (MIT) compiled against the CUDA Toolkit.
• onnxruntime_providers_cuda.dll — derived from ONNX Runtime (MIT) compiled against CUDA.

The AnimStart in-app installer surfaces both NVIDIA EULAs as direct links and treats a click on "Install" as user acceptance (Soft-EULA model). The acceptance is persisted per-installation so the dialog doesn't re-prompt.

---

Versioning

The repo tracks a single rolling pack on main. When the CUDA Toolkit or cuDNN version changes, the entire pack is re-uploaded — git history preserves prior versions for any downstream clients that pinned a SHA in their manifest.

Current version is encoded in the manifest.json baked into the AnimStart binary (field version, e.g. v12.4-cudnn9).

---

Why this pack instead of asking users to install CUDA?

1. One-click UX — typical users don't know what CUDA Toolkit is or which version AnimStart wants. Installing the full toolkit (~3 GB developer tools they don't need) is wasteful.
2. Version isolation — different apps using different CUDA versions conflict in PATH. By keeping our copy in <APPDATA>/AnimHaven/ and registering only for our process, we don't pollute the system-wide DLL search order.
3. Exact ABI match — the ggml-cuda.dll and onnxruntime_providers_cuda.dll shipped here are compiled against the specific CUDA Toolkit version in this repo. A user-supplied different version would either fail to link or produce subtle inference bugs.