User-Intent Aware Transport-Layer Intelligence for Frame Synchronisation in Multi-Party XR Application

Emerging immersive media applications demand tailored performance to accommodate diverse user intents, particularly in scenarios with multiple users with different intents and requiring frame synchronisation. This paper introduces a novel transport-layer intelligence scheme that leverages a user intent-aware API. This API enables the application layer to communicate specific user intents and requirements to the transport layer, optimizing immersive application performance. Using deep reinforcement learning, our solution automatically selects the optimal transport protocol and configuration for each user intent across various immersive scenarios. Our evaluation focuses on a live immersive video streaming application, with different users transmitting volumetric content under different network conditions. Results demonstrate that our scheme accurately identifies suitable transport protocols and tailored configurations for a wide range of user intents, ensuring multi-user frame Synchronisation.