FlashRT-PAI: Fast Kernels Are Not Fast Pipelines for Physical AI Inference

Vision-language-action (VLA), video-action (VA), and world action models (WAMs) form the backbone of modern physical AI systems, yet their real-time single-batch inference remains a defining bottleneck. Latency is dominated not by individual kernel computation, but by system-level overhead: thousands of short kernel launches, intermediate data movement across operator boundaries, and redundant…

Publisher's summary from arXiv cs.AI. Read the full article on arXiv cs.AI · More from arXiv cs.AI