vllm root
vllm serve Qwen/Qwen2.5-VL-7B-Instruct --tensor-parallel-size 1 --mm-encoder-tp-mode data vllm serve Qwen/Qwen2.5-VL-7B-Instruct \
--tensor-parallel-size 1 \
--mm-encoder-tp-mode data - validated on
- trillium, xeon6
- source
- vllm-recipes