Commit History

Drop attention_mask at inference: the checkpoint was trained without one, and generate()'s auto-mask degenerates the output
710a168
Running
verified

SeaWolf-AI commited on

Serve with greedy decoding: sampling hallucinates on this lightly-tuned checkpoint
cd0a95c
verified

SeaWolf-AI commited on

fix: unwrap BatchEncoding from apply_chat_template before generate()
7421815
verified

SeaWolf-AI commited on

diagnostics: full traceback in gen_error
6ea129e
verified

SeaWolf-AI commited on

diagnostics: surface gen_error + vram in /api/health
278f8b3
verified

SeaWolf-AI commited on

serving: manual load + GenerationMixin + use_cache=False + streaming
e1c8763
verified

SeaWolf-AI commited on

serving: manual load + GenerationMixin + use_cache=False + streaming
95738ea
verified

SeaWolf-AI commited on

add app.py
b5344b2
verified

SeaWolf-AI commited on