trajis-tech commited on
Commit
f4e298f
·
verified ·
1 Parent(s): 7f8cbe8

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # llama-cpp-python (Windows CUDA build)
2
+
3
+ Prebuilt wheel for:
4
+
5
+ - Windows x64
6
+ - Python 3.12 (cp312)
7
+ - CUDA enabled
8
+ - AVX512 disabled
9
+ - Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs
10
+
11
+ ---
12
+
13
+ ## Install
14
+
15
+ Direct install:
16
+
17
+ pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl"
18
+
19
+ Or download manually and install:
20
+
21
+ pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl
22
+
23
+ ---
24
+
25
+ ## Uninstall
26
+
27
+ pip uninstall llama-cpp-python
28
+
29
+ ---
30
+
31
+ ## Requirements
32
+
33
+ - Windows 64-bit
34
+ - Python 3.12
35
+ - NVIDIA GPU
36
+ - CUDA Toolkit installed