vLLM splits multimodal encoding into its own instances: 6.6–9.5% more throughput per GPU on DeepSeek V4.1 Flash
vLLM now lets multimodal serving deploy encoding, prefill and decode as separately scaled instances (EPD), so encoder capacity for images, video and audio can grow independently of the language model. The release adds metadata-only request forwarding, a dedicated encoder execution path, remote embedding transfer and cross-encoder cache reuse. On DeepSeek V4.1 Flash document question answering at concurrency 64–128, input-plus-output throughput per GPU across all 12 EPD GPUs was 6.6–9.5% above an eight-GPU PD baseline and P90 time-to-first-token was 44–47% lower, while at concurrency 16 EPD was slower.