Drop Vulkan throughput claim: smoke-tested only
Browse files
README.md
CHANGED
|
@@ -75,11 +75,11 @@ Mainline llama.cpp does not load `clover_moe`. This build adds the converter, th
|
|
| 75 |
| Linux x86_64 | NVIDIA sm_80 / 86 / 89 / 90 (A100, A10G, L40S, RTX 4090, H100/H200) | CUDA 12.0 | shipped |
|
| 76 |
| Linux x86_64 | NVIDIA Blackwell sm_100/120, AMD, Intel | none | not in this build |
|
| 77 |
| Windows x86_64 | NVIDIA sm_50 through sm_120 (Maxwell to Blackwell) | CUDA 12.8 | shipped |
|
| 78 |
-
| Windows x86_64 | AMD and Intel GPUs | Vulkan 1.4.363 | shipped,
|
| 79 |
| Windows x86_64 | Any x86-64 CPU | per-CPU DLLs, AVX-512 off | shipped |
|
| 80 |
| macOS, ARM64, ROCm on any OS | - | none | not published |
|
| 81 |
|
| 82 |
-
|
| 83 |
|
| 84 |
Windows is native. The ZIP carries its CUDA 12.8 libraries and uses the Vulkan loader from the GPU driver; extract it and run `set PATH=%~dp0bin;%PATH%` from the archive root. It ships the same tool set as the Linux archives, including `llama-speculative-simple`, `llama-quantize` and `llama-imatrix`.
|
| 85 |
|
|
|
|
| 75 |
| Linux x86_64 | NVIDIA sm_80 / 86 / 89 / 90 (A100, A10G, L40S, RTX 4090, H100/H200) | CUDA 12.0 | shipped |
|
| 76 |
| Linux x86_64 | NVIDIA Blackwell sm_100/120, AMD, Intel | none | not in this build |
|
| 77 |
| Windows x86_64 | NVIDIA sm_50 through sm_120 (Maxwell to Blackwell) | CUDA 12.8 | shipped |
|
| 78 |
+
| Windows x86_64 | AMD and Intel GPUs | Vulkan 1.4.363 | shipped, smoke-tested on one Intel iGPU |
|
| 79 |
| Windows x86_64 | Any x86-64 CPU | per-CPU DLLs, AVX-512 off | shipped |
|
| 80 |
| macOS, ARM64, ROCm on any OS | - | none | not published |
|
| 81 |
|
| 82 |
+
Throughput measured with the NanoPlus GGUF in this build: 6.75 t/s on CPU, 8.51 t/s on CUDA at `-ngl 8`. Vulkan was only smoke-tested on a basic Intel iGPU to confirm it loads and generates; no throughput claim is made for AMD or Intel GPUs. Coverage here means the model runs, not that every backend is benchmarked.
|
| 83 |
|
| 84 |
Windows is native. The ZIP carries its CUDA 12.8 libraries and uses the Vulkan loader from the GPU driver; extract it and run `set PATH=%~dp0bin;%PATH%` from the archive root. It ships the same tool set as the Linux archives, including `llama-speculative-simple`, `llama-quantize` and `llama-imatrix`.
|
| 85 |
|