feat: ZeroGPU backend for Hugging Face Spaces deployment (#4) 864480d unverified j14i Claude Opus 4.8 commited on Jun 7
feat: implement automatic CPU fallback for ZeroGPU queue lease execution failures 7366eb1 j14i commited on Jun 6
Optimize ZeroGPUBackend model loading by caching weights in system CPU RAM at startup/request start, moving to GPU instantly only during leases to bypass Expired ZeroGPU proxy token timeouts 7d2f9d4 j14i commited on Jun 6
Fix ZeroGPU: module-level model loading with bfloat16, drop bitsandbytes 124598f j14i commited on Jun 6
Fix: prevent low-level CUDA init outside of spaces.GPU decorator on ZeroGPU 49f39d9 j14i commited on Jun 6
fix: load quantized model with device_map='auto' and explicit max_memory for ZeroGPU emulation eff50b2 j14i commited on Jun 6
fix: resolve NVML assertion failure in ZeroGPU backend by loading globally b190c42 j14i commited on Jun 6
Support dynamic devices (MPS/CPU) on ZeroGPUBackend for local macOS testing 19dd7c8 j14i commited on Jun 5
Improve model load error logging in ZeroGPUBackend by printing the full traceback b120ca2 j14i commited on Jun 5
Implement switchable LLM backends (BAML & ZeroGPU) for HF Spaces deployment c1cd6a2 j14i commited on Jun 5