File size: 4,270 Bytes
e9d7c70 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 | ---
license: other
license_name: nvidia-cuda-toolkit-eula
license_link: https://docs.nvidia.com/cuda/eula/index.html
tags:
- cuda
- cudnn
- windows
- runtime
- animhaven
---
# AnimHaven CUDA Runtime
NVIDIA **CUDA Toolkit + cuDNN runtime DLLs** for the AnimHaven app
family ([AnimStart](https://github.com/Initnatsnok/animstart), AnimRoom).
Distributed separately from the application installers so the base
download stays small (~150 MB) and only NVIDIA-GPU users pull these
~2.85 GB of native libraries on demand.
---
## What's in this repo
A flat directory of Windows `.dll` files comprising:
| Family | Files | Approx. size |
|---|---|---:|
| **CUDA Toolkit** | `cublas64_12.dll`, `cublasLt64_12.dll`, `cudart64_12.dll` | ~548 MB |
| **cuDNN** | `cudnn*.dll` (engines, graph, ops, heuristic) | ~947 MB |
| **CUDA Math** | `cufft64_11.dll`, `cufftw64_11.dll`, `curand64_10.dll` | ~350 MB |
| **NVRTC** | `nvJitLink_120_0.dll`, `nvrtc*.dll` | ~262 MB |
| **CUDA engine bindings** | `ggml-cuda.dll` (from llama.cpp build), `onnxruntime_providers_cuda.dll` | ~741 MB |
| **Total** | ~20 files | **~2.85 GB** |
All files are NVIDIA's redistributable binaries vendored from the CUDA
Toolkit installer + cuDNN release. No modifications.
---
## Usage
**This repo is consumed by the in-app installer** — you typically don't
download it directly. AnimStart's SetupWizard ("GPU acceleration"
step) and Settings → Advanced → "GPU acceleration" both pull these
files via HuggingFace LFS into `<APPDATA>/AnimHaven/cuda_runtime/`,
verify SHA256, and register the directory with the Windows DLL loader
via `AddDllDirectoryW`.
The manifest (file paths + sizes + SHA256) is **baked into the
AnimStart binary** at compile time via
`include_str!("anim-shared/cuda-runtime-manifest.json")`, so the
installer has zero network round-trips on top of the file downloads
themselves.
### Direct download (advanced)
If you need to manually populate `cuda_runtime/`, e.g. for offline
provisioning of a kiosk machine, clone the repo with Git LFS:
```bash
git lfs install
git clone https://huggingface.co/Animhaven/cuda-runtime
# Copy contents of cuda-runtime/ to %APPDATA%/AnimHaven/cuda_runtime/
```
---
## License
The DLLs in this repo are NVIDIA software, redistributed under their
respective EULAs:
- **CUDA Toolkit components** (`cublas*.dll`, `cudart*.dll`, `cufft*.dll`,
`curand*.dll`, `nvJitLink*.dll`, `nvrtc*.dll`) — covered by the
[NVIDIA CUDA Toolkit End User License Agreement](https://docs.nvidia.com/cuda/eula/index.html).
- **cuDNN components** (`cudnn*.dll`) — covered by the
[NVIDIA cuDNN Software License Agreement](https://docs.nvidia.com/deeplearning/cudnn/sla/index.html).
- **`ggml-cuda.dll`** — derived from llama.cpp (MIT) compiled against
the CUDA Toolkit.
- **`onnxruntime_providers_cuda.dll`** — derived from ONNX Runtime
(MIT) compiled against CUDA.
The AnimStart in-app installer surfaces both NVIDIA EULAs as direct
links and treats a click on "Install" as user acceptance (Soft-EULA
model). The acceptance is persisted per-installation so the dialog
doesn't re-prompt.
---
## Versioning
The repo tracks a single rolling pack on `main`. When the CUDA Toolkit
or cuDNN version changes, the entire pack is re-uploaded — git history
preserves prior versions for any downstream clients that pinned a SHA
in their manifest.
Current version is encoded in the `manifest.json` baked into the
AnimStart binary (field `version`, e.g. `v12.4-cudnn9`).
---
## Why this pack instead of asking users to install CUDA?
1. **One-click UX** — typical users don't know what CUDA Toolkit is or
which version AnimStart wants. Installing the full toolkit (~3 GB
developer tools they don't need) is wasteful.
2. **Version isolation** — different apps using different CUDA versions
conflict in `PATH`. By keeping our copy in `<APPDATA>/AnimHaven/`
and registering only for our process, we don't pollute the
system-wide DLL search order.
3. **Exact ABI match** — the `ggml-cuda.dll` and
`onnxruntime_providers_cuda.dll` shipped here are compiled against
the specific CUDA Toolkit version in this repo. A user-supplied
different version would either fail to link or produce subtle
inference bugs.
|