Abstract: Tele-immersive 3D multi-camera, multi-display room environments are emerging and with them new challenging research questions. One important question is how to organize the large amount of visual data, being captured, processed, transmitted and displayed, and their corresponding resources over current COTS computing and networking infrastructures so that “everybody” would be able to install and use tele-immersive environments for interactive physical activities. In this talk, I introduce the concept of a view to deal with and translate between the large amount of data, these immersive and interactive environments produce, and the bandwidth/delay barriers of current COTS networks and operating systems for these environments. I will discuss our cross-layer control, adaptive streaming framework with view dissemination, called TEEVE (Tele-immersive Environments for EVErybody). TEEVE aims for (1) effective and adaptive coordination, synchronization and soft QoS-enabled delivery of tele-immersive visual streams to remote rooms, and (2) effective view-casting model for different view dissemination in the multi-party 3D tele-immersive environments.
This is a joint work with Zhenyu Yang, Wanmin Wu, and Ruzena Bajcsy.