Fix adapter loading: use set_peft_model_state_dict (plain load_state_dict silently no-opped the LoRA) 6d10ca3 verified strfry commited on Jun 29
Fix: use pre-quantized int8 model + manual CPU adapter loading d7ad67a verified strfry commited on Jun 29
Fix: device_map=auto for base (ZeroGPU auto-transfer) + lazy adapter 9d52cf4 verified strfry commited on Jun 29
Fix: base on CPU (device_map=cpu), adapter lazily inside @spaces.GPU 6bb9245 verified strfry commited on Jun 29
Fix: device_map=cpu for ZeroGPU compat (avoids CUDA emulation hooks with bitsandbytes+safetensors) ff0283d verified strfry commited on Jun 29
Fix: load LoRA adapter inside @spaces.GPU (safetensors fails in CUDA emulation mode) 1210ae6 verified strfry commited on Jun 29
Restore duration=120 for stability; keep replace-based im_end stripping 45a9397 verified strfry commited on Jun 29
Reduce ZeroGPU duration to 30s; add HF_TOKEN for higher quota ee4bc2b verified strfry commited on Jun 29
Fix: strip <|im_end|> post-decode; eos_token_id is useless (model generates im_end as subword tokens) 81f03e3 verified strfry commited on Jun 29
Fix: pass eos_token_id to generate() and add safety truncation at im_start tokens cb6ace2 verified strfry commited on Jun 29
Switch to Apertus-8B youtube adapter; XX→PR only; show fixed system prompt 3576333 verified strfry commited on Jun 29
Fall back to device_map=cpu when no GPU (bnb 4-bit CPU backend) 0f0438e verified strfry commited on Jun 22
Fix generate(): return_dict=True + generate(**inputs) (BatchEncoding has no .shape) 43c0e95 verified strfry commited on Jun 22
Lazy-load model inside GPU fn; drop removed show_copy_button (gradio 6) af44151 verified strfry commited on Jun 22