blogvLLM Blog·23 Oct 20265.2
vLLM fits long agentic contexts for GLM-5.3 on 16 H200s by splitting prefill and decode nodes and using prefill and decode context parallelism plus hybrid sparse attention.
blogvLLM Blog·23 Oct 20265.1
vLLM serves DeepSeek-V4.1-Flash on one GB300 NVL72 rack at 954K tokens per second per GPU using prefill and decode disaggregation and wide expert parallelism, 7.9 times its single-node result.
paperIEEE Xplore·1 Nov 20263.1
EcoxPU orchestrates disaggregated LLM inference across heterogeneous accelerators with agents to cut energy use.