Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,31 @@
|
|
| 1 |
---
|
| 2 |
license: cc-by-sa-4.0
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: cc-by-sa-4.0
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
This repository contains libraries that pre-built locally.
|
| 6 |
+
|
| 7 |
+
My purpose is developing private spaces for free access to models via Gradio using CPU-only, so that models cannot be downloaded but can be served.
|
| 8 |
+
|
| 9 |
+
In CPU-only spaces, the llama-cpp-python online build fails due to OOM / timeout
|
| 10 |
+
|
| 11 |
+
Hence, built it locally under Ubuntu 24.04, for the environment that as of 2026-05-15 was shown within the HF Space:
|
| 12 |
+
|
| 13 |
+
<code>
|
| 14 |
+
3.13.13 (main, May 8 2026, 22:42:09) [GCC 14.2.0]
|
| 15 |
+
x86_64
|
| 16 |
+
('glibc', '2.41')
|
| 17 |
+
3.13.13 (main, May 8 2026, 22:42:09) [GCC 14.2.0]
|
| 18 |
+
x86_64
|
| 19 |
+
('glibc', '2.41')
|
| 20 |
+
</code>
|
| 21 |
+
|
| 22 |
+
The script (as temporary app.py, with no requirement.txt) to verify the hf default configuration for a CPU-only private space is:
|
| 23 |
+
<code>
|
| 24 |
+
import sys, platform
|
| 25 |
+
print(sys.version) # e.g. 3.11.9
|
| 26 |
+
print(platform.machine()) # x86_64
|
| 27 |
+
print(platform.libc_ver()) # glibc 2.35 → Ubuntu 22.04
|
| 28 |
+
</code>
|
| 29 |
+
|
| 30 |
+
First library built:
|
| 31 |
+
_ llama_cpp_python-0.3.23-py3-none-linux_x86_64.whl
|