|
|
--- |
|
|
license: mit |
|
|
tags: |
|
|
- llama-cpp |
|
|
- llama-cpp-python |
|
|
- windows |
|
|
- cuda |
|
|
- wheel |
|
|
- cp312 |
|
|
library_name: llama-cpp-python |
|
|
--- |
|
|
|
|
|
|
|
|
# llama-cpp-python (Windows CUDA build) |
|
|
|
|
|
Prebuilt wheel for: |
|
|
|
|
|
- Windows x64 |
|
|
- Python 3.12 (cp312) |
|
|
- CUDA enabled |
|
|
- AVX512 disabled |
|
|
- Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs |
|
|
|
|
|
--- |
|
|
|
|
|
## Install |
|
|
|
|
|
Direct install: |
|
|
|
|
|
pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl" |
|
|
|
|
|
Or download manually and install: |
|
|
|
|
|
pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl |
|
|
|
|
|
--- |
|
|
|
|
|
## Uninstall |
|
|
|
|
|
pip uninstall llama-cpp-python |
|
|
|
|
|
--- |
|
|
|
|
|
## Requirements |
|
|
|
|
|
- Windows 64-bit |
|
|
- Python 3.12 |
|
|
- NVIDIA GPU |
|
|
- CUDA Toolkit installed |
|
|
|
