When will this be added to the main branch instead of the vLLM fork version?
#6
by ufoscw - opened
When will this be added to the main branch instead of the vLLM fork version?
Thank you for reaching out.
We have submitted this change to the upstream vLLM repository as https://github.com/vllm-project/vllm/pull/32407 .
Availability in the main branch depends on the upstream review and merge process.
Until then, please refer to PR #32407 for ongoing progress and updates.
singleheart changed discussion status to closed