Fix adapter loading: use set_peft_model_state_dict (plain load_state_dict silently no-opped the LoRA) 6d10ca3 Running verified strfry commited on 10 days ago
Fix: use pre-quantized int8 model + manual CPU adapter loading d7ad67a verified strfry commited on 10 days ago
Use pre-quantized int8 model + manual CPU adapter loading (no bitsandbytes config, no lazy loading, no safetensors CUDA issue) a14a1a8 verified strfry commited on 10 days ago
Rename: Old Prussian → New Prussian throughout the app 88e22b9 verified strfry commited on 11 days ago
Fix: device_map=auto for base (ZeroGPU auto-transfer) + lazy adapter 9d52cf4 verified strfry commited on 11 days ago
Fix: base on CPU (device_map=cpu), adapter lazily inside @spaces.GPU 6bb9245 verified strfry commited on 11 days ago
Fix: device_map=cpu for ZeroGPU compat (avoids CUDA emulation hooks with bitsandbytes+safetensors) ff0283d verified strfry commited on 11 days ago
Fix: load LoRA adapter inside @spaces.GPU (safetensors fails in CUDA emulation mode) 1210ae6 verified strfry commited on 11 days ago
ZeroGPU optimization: move model loading to module level, reduce max_new_tokens to 100 6a250bc verified strfry commited on 11 days ago
Restore duration=120 for stability; keep replace-based im_end stripping 45a9397 verified strfry commited on 11 days ago
Use removesuffix instead of regex for im_end stripping efac088 verified strfry commited on 11 days ago
Reduce ZeroGPU duration to 30s; add HF_TOKEN for higher quota ee4bc2b verified strfry commited on 11 days ago
Fix: strip <|im_end|> post-decode; eos_token_id is useless (model generates im_end as subword tokens) 81f03e3 verified strfry commited on 11 days ago
Fix: pass eos_token_id to generate() and add safety truncation at im_start tokens cb6ace2 verified strfry commited on 11 days ago
Switch to Apertus-8B youtube adapter; XX→PR only; show fixed system prompt 3576333 verified strfry commited on 11 days ago
Fall back to device_map=cpu when no GPU (bnb 4-bit CPU backend) 0f0438e verified strfry commited on 18 days ago
Fix generate(): return_dict=True + generate(**inputs) (BatchEncoding has no .shape) 43c0e95 verified strfry commited on 18 days ago
Lazy-load model inside GPU fn; drop removed show_copy_button (gradio 6) af44151 verified strfry commited on 18 days ago
Bump gradio to 6.19.0; drop gradio pin from requirements 4ca3197 verified strfry commited on 18 days ago
Pin Python 3.11 (audioop removed in 3.13 breaks pydub/gradio) 60c2f6c verified strfry commited on 18 days ago