--- license: mit tags: - llama-cpp - llama-cpp-python - windows - cuda - wheel - cp312 library_name: llama-cpp-python --- # llama-cpp-python (Windows CUDA build) Prebuilt wheel for: - Windows x64 - Python 3.12 (cp312) - CUDA enabled - AVX512 disabled - Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs --- ## Install Direct install: pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl" Or download manually and install: pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl --- ## Uninstall pip uninstall llama-cpp-python --- ## Requirements - Windows 64-bit - Python 3.12 - NVIDIA GPU - CUDA Toolkit installed