exp-chat-rag / src /generation.py

Commit History

revert: simple lazy loading inside @spaces.GPU β€” working baseline
7346617

Arnic commited on

fix: initialize self.pipe = None in __init__ β€” prevent AttributeError
c196b3e

Arnic commited on

fix: @spaces.GPU on standalone function, not class method β€” ZeroGPU compat
9917e61

Arnic commited on

fix: proper ZeroGPU lifecycle β€” try/finally CPU offload, @spaces.GPU on generate()
54657b7

Arnic commited on

fix: recreate pipeline each request β€” ZeroGPU deallocates GPU between calls
4bac7af

Arnic commited on

perf: decouple CPU retrieval from GPU generation β€” 10x GPU quota savings
746d35c

Arnic commited on

fix: torch_dtype→dtype deprecation, remove pad_token_id conflict with generation_config
665b6f5

Arnic commited on

fix: remove device_map conflict, load onto GPU inside @spaces.GPU context
6fbfd9a

Arnic commited on

fix: full lazy model loading for ZeroGPU β€” remove preload thread, defer pipeline init to first request
0070274

Arnic commited on

refactor: Gradio 5.30 compat + spaces first import + deferred torch in generation.py
0bb8b99

Arnic commited on

refactor: ZeroGPU-compatible β€” spaces first import, @spaces.GPU on generate(), deferred torch/transformers
c1272c5

Arnic commited on

fix: dummy @spaces.GPU placeholder β€” no GPU allocation, no quota consumption (same pattern as neurorag-2026)
acbca58

Arnic commited on

fix: keep @spaces.GPU(duration=15) β€” zero-a10g requires it, but with HF_TOKEN secret for authenticated quota
31071e1

Arnic commited on

fix: remove @spaces.GPU β€” run on CPU to eliminate ZeroGPU quota errors for website visitors
d7b1aaa

Arnic commited on

fix: use GPU properly β€” @spaces.GPU + device_map=auto for A10G
09d4d23

Arnic commited on

Aethron Portfolio Agent v2: Phi-3.5-mini + FAISS + keyword fallback, HF Spaces compatible
a3037d6

Arnic commited on