File size: 752 Bytes
b6bc271 f4e298f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
---
license: mit
tags:
- llama-cpp
- llama-cpp-python
- windows
- cuda
- wheel
- cp312
library_name: llama-cpp-python
---
# llama-cpp-python (Windows CUDA build)
Prebuilt wheel for:
- Windows x64
- Python 3.12 (cp312)
- CUDA enabled
- AVX512 disabled
- Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs
---
## Install
Direct install:
pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl"
Or download manually and install:
pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl
---
## Uninstall
pip uninstall llama-cpp-python
---
## Requirements
- Windows 64-bit
- Python 3.12
- NVIDIA GPU
- CUDA Toolkit installed
|