GPU final: model resident on cuda (no per-call transfer) + 240s budget + one-shot β fixes empty-output timeout 54342fa verified AndresCarreon commited on 29 days ago
REAL MODEL on reliable CPU: llama.cpp 4B Nemotron, one-shot, compact prompt; cpu-basic hardware a1fdcfe verified AndresCarreon commited on 29 days ago
match the working bench EXACTLY: .to(cuda) inside the GPU call every time (no caching) β fixes the persistent NVML on the live single call 0606513 verified AndresCarreon commited on 29 days ago
ONE-SHOT plan generation for ZeroGPU: whole wish in a single @spaces.GPU call (ends the multi-call NVML crash, far faster) + deterministic town fallback so a wish never builds nothing 6ccf62b verified AndresCarreon commited on 29 days ago
FIX multi-call NVML crash: eager .to(cuda) under spaces at load (manages GPU residency across a wish's many calls) β not lazy-per-call 89c0fb9 verified AndresCarreon commited on 29 days ago
back to zerogpu (CPU-only app is killed on ZeroGPU hardware) + retry transient NVML/CUDA failures on a fresh GPU schedule f78115e verified AndresCarreon commited on 30 days ago
switch live backend to llama.cpp (CPU, GBNF-constrained) β reliable, ends the ZeroGPU NVML flakiness; max threads 8e60650 verified AndresCarreon commited on 30 days ago
FIX zerogpu NVML crash: defer cuda placement into the GPU context (no startup CUDA init); reject failed wishes honestly instead of empty-granting 5789bc7 verified AndresCarreon commited on 30 days ago
strip echoed READING label; fix status sky suffix accretion e947a5e verified AndresCarreon commited on 30 days ago
gradio Server mode + browser-invoked granting (the her idiom) 3d6a43c verified AndresCarreon commited on 30 days ago