Commit History

Optimize speculative decoding performance by increasing max_num_batched_tokens to 4096
a0613f9

encryptd commited on

Upgrade to vllm 0.12.0 and restore original performance arguments for Qwen 3.5 support
1cc1c9e

encryptd commited on

Remove limit-mm-per-prompt argument to bypass vLLM 0.8.0 multimodal registration check
c2fa736

encryptd commited on

Remove speculative-config argument for vLLM 0.8.0 CLI parser
20df6b8

encryptd commited on

Fix limit-mm-per-prompt syntax for vLLM 0.8.0 CLI parser
7f9201a

encryptd commited on

Fix: Upgrade to vLLM 0.22.0 and PyTorch 2.11.0 on CUDA 12.4 for native Qwen 3.5 support and host compatibility
359492c

encryptd commited on

Fix: Remove speculative-config argument for vLLM 0.7.2 CLI compliance
e776eb6

encryptd commited on

Fix: Update --limit-mm-per-prompt format to KEY=VALUE format image=99 for vLLM 0.7.2
a5a317d

encryptd commited on

Fix: Align vLLM arguments with model card recommendations (chat format, MTP speculative config, limit-mm-per-prompt)
244de46

encryptd commited on

Fix: Remove limit-mm-per-prompt and mm-processor-kwargs for vLLM 0.7.2 compatibility
9700b91

encryptd commited on

Fix: Update --limit-mm-per-prompt format to KEY=VALUE for vLLM 0.7.2 compatibility
b7c3dd4

encryptd commited on

Fix: Remove show_copy_button parameter from gr.Textbox for Gradio 6 compatibility
5aa37ab

encryptd commited on

Initial commit: NuExtract3 Gradio space setup powered by vLLM on A100 GPU
88dbb61

encryptd commited on