vllm root
vllm/vllm-openai:latest argv — what a wrapper execs
vllm serve google/gemma-4-31B-it --tensor-parallel-size 1 --enable-auto-tool-choice --tool-call-parser gemma4 --chat-template examples/tool_chat_template_gemma4.jinja --reasoning-parser gemma4
as the source printed it
vllm serve google/gemma-4-31B-it \
--tensor-parallel-size 1 \
--enable-auto-tool-choice \
--tool-call-parser gemma4 \
--chat-template examples/tool_chat_template_gemma4.jinja \
--reasoning-parser gemma4
- validated on
- h100, mi300x, mi325x, mi355x, trillium, ironwood, arc_pro_b60, arc_pro_b70