aimedlab-pulse-hf / handler.py

Commit History

fix: decode slice (gen_ids[0,-max_new:]) + defaults temp=0.2/max=2000/rep=1.05
bc3b274
verified

brunopires01 commited on

fix: BF16 dtype for PULSE-7B (mat1/mat2 dtype mismatch)
8f0b954
verified

brunopires01 commited on

fix: pass input_ids as inputs= (LLaVA generate signature)
e843d1f
verified

brunopires01 commited on

fix: force llava prefix in model_name so builder loads vision tower
bed0fa2
verified

brunopires01 commited on

Fix: unset HF_MODEL_DIR so toolkit does not conflict with HF_MODEL_ID
4cd44cc
verified

brunopires01 commited on

Vendor LLaVA v1.2.0 + thin handler (no pip install at runtime)
8d008f8
verified

brunopires01 commited on