Commit History

Fix adapter loading: use set_peft_model_state_dict (plain load_state_dict silently no-opped the LoRA)
6d10ca3
Running
verified

strfry commited on

Fix: use pre-quantized int8 model + manual CPU adapter loading
d7ad67a
verified

strfry commited on

Fix: restore correct requirements.txt
4fbadd3
verified

strfry commited on

Use pre-quantized int8 model + manual CPU adapter loading (no bitsandbytes config, no lazy loading, no safetensors CUDA issue)
a14a1a8
verified

strfry commited on

doc: clarify duration=120 vs actual inference time
7960d66
verified

strfry commited on

Rename: Old Prussian → New Prussian throughout the app
88e22b9
verified

strfry commited on

Fix: device_map=auto for base (ZeroGPU auto-transfer) + lazy adapter
9d52cf4
verified

strfry commited on

Fix: base on CPU (device_map=cpu), adapter lazily inside @spaces.GPU
6bb9245
verified

strfry commited on

Fix: device_map=cpu for ZeroGPU compat (avoids CUDA emulation hooks with bitsandbytes+safetensors)
ff0283d
verified

strfry commited on

Fix: load LoRA adapter inside @spaces.GPU (safetensors fails in CUDA emulation mode)
1210ae6
verified

strfry commited on

Fix: re-upload correct requirements.txt
60bba32
verified

strfry commited on

Fix: re-upload correct app.py (ZeroGPU optimization)
68d9d5a
verified

strfry commited on

ZeroGPU optimization: move model loading to module level, reduce max_new_tokens to 100
6a250bc
verified

strfry commited on

Restore duration=120 for stability; keep replace-based im_end stripping
45a9397
verified

strfry commited on

Use replace instead of removesuffix for im_end
395ab24
verified

strfry commited on

Fix: strip newline before removesuffix
b428cd1
verified

strfry commited on

Use removesuffix instead of regex for im_end stripping
efac088
verified

strfry commited on

Reduce ZeroGPU duration to 30s; add HF_TOKEN for higher quota
ee4bc2b
verified

strfry commited on

Fix: strip <|im_end|> post-decode; eos_token_id is useless (model generates im_end as subword tokens)
81f03e3
verified

strfry commited on

Fix: pass eos_token_id to generate() and add safety truncation at im_start tokens
cb6ace2
verified

strfry commited on

Load base in int8 to match training quantization
16ba63b
verified

strfry commited on

Remove Palmaitis/Klussis reference
d1eaecd
verified

strfry commited on

Switch to Apertus-8B youtube adapter; XX→PR only; show fixed system prompt
3576333
verified

strfry commited on

Fall back to device_map=cpu when no GPU (bnb 4-bit CPU backend)
0f0438e
verified

strfry commited on

Fix generate(): return_dict=True + generate(**inputs) (BatchEncoding has no .shape)
43c0e95
verified

strfry commited on

Lazy-load model inside GPU fn; drop removed show_copy_button (gradio 6)
af44151
verified

strfry commited on

Remove stray __pycache__ pyc
072ff60
verified

strfry commited on

Bump gradio to 6.19.0; drop gradio pin from requirements
4ca3197
verified

strfry commited on

Pin Python 3.11 (audioop removed in 3.13 breaks pydub/gradio)
60c2f6c
verified

strfry commited on

Add Old Prussian translator Gradio demo
86f1c8d
verified

strfry commited on

initial commit
e504052
verified

strfry commited on