Optimize speculative decoding performance by increasing max_num_batched_tokens to 4096 a0613f9 encryptd commited on Jun 1
Upgrade to vllm 0.12.0 and restore original performance arguments for Qwen 3.5 support 1cc1c9e encryptd commited on Jun 1
Remove limit-mm-per-prompt argument to bypass vLLM 0.8.0 multimodal registration check c2fa736 encryptd commited on Jun 1
Fix: Upgrade to vLLM 0.22.0 and PyTorch 2.11.0 on CUDA 12.4 for native Qwen 3.5 support and host compatibility 359492c encryptd commited on Jun 1
Fix: Remove speculative-config argument for vLLM 0.7.2 CLI compliance e776eb6 encryptd commited on Jun 1
Fix: Update --limit-mm-per-prompt format to KEY=VALUE format image=99 for vLLM 0.7.2 a5a317d encryptd commited on Jun 1
Fix: Align vLLM arguments with model card recommendations (chat format, MTP speculative config, limit-mm-per-prompt) 244de46 encryptd commited on Jun 1
Fix: Remove limit-mm-per-prompt and mm-processor-kwargs for vLLM 0.7.2 compatibility 9700b91 encryptd commited on Jun 1
Fix: Update --limit-mm-per-prompt format to KEY=VALUE for vLLM 0.7.2 compatibility b7c3dd4 encryptd commited on May 31
Fix: Remove show_copy_button parameter from gr.Textbox for Gradio 6 compatibility 5aa37ab encryptd commited on May 31
Initial commit: NuExtract3 Gradio space setup powered by vLLM on A100 GPU 88dbb61 encryptd commited on May 30