Bump @spaces.GPU duration 60→120s (32B Q4_K_M first-call can exceed 60s) cc01470 verified Dellboy commited on 28 days ago
update README: Gradio API endpoint, cu130/CUDA 13, cold-start notes, confirmed working f9caab9 Dellboy commited on 28 days ago
switch to cu130 wheel — native CUDA 13 build, no compat shim needed 6a73559 Dellboy commited on 28 days ago
production v5: patch all .so.13→.so.12 nvidia libs + RTLD_GLOBAL preload all 412a9c1 Dellboy commited on 28 days ago
production v4: binary-patch soname libcudart.so.13→.so.12 + RTLD_GLOBAL preload 08070eb Dellboy commited on 28 days ago
production v3: patchelf add-rpath + RTLD_GLOBAL preload for cuda abi c1d613a Dellboy commited on 28 days ago
production v2: correct cuda compat path (nvidia/cu13/lib), n_gpu_layers=-1 9c4e379 Dellboy commited on 28 days ago
cuda compat inside worker + lazy model load + n_gpu_layers=-1 a0cbdb0 Dellboy commited on 28 days ago
cpu-only: use CPU llama-cpp wheel, n_gpu_layers=0, no CUDA dep b76a913 Dellboy commited on 28 days ago
production v1: CUDA 13 compat shim + CPU fallback (n_gpu_layers=0) 239c7b2 Dellboy commited on 28 days ago
CUDA compat shim: symlink libcudart.so.12→.so.13 for Blackwell ZeroGPU da81dd8 Dellboy commited on 28 days ago
build llama-cpp-python from source (CMAKE_ARGS=-DGGML_CUDA=on, CUDA 13.0) 5374f5b Dellboy commited on 28 days ago
pre-download GGUF at startup (outside GPU lease) to fix ZeroGPU timeout d90ddcb Dellboy commited on 28 days ago
reduce @spaces.GPU duration to 60s to fit ZeroGPU free-tier limit 00bda23 Dellboy commited on 28 days ago
production: @spaces.GPU + Gradio call API (llama_cpp GGUF 32b) 89db542 Dellboy commited on 28 days ago