2016-2018. Role: project leader.
In a world increasingly driven by technology, the demand for immersive experiences has never been higher. Conventional video conferencing and communication tools fail to capture the essence of real-world interactions, leaving users feeling disconnected and unsatisfied. To address this challenge, we present a groundbreaking solution for immersive communications, utilizing mixed reality telepresence to bridge the gap between physical and virtual worlds. Our system seamlessly blends real-time 3D capture, volumetric rendering, and full parallax support to create a truly lifelike experience where remote users feel like they are face-to-face, sharing virtual spaces and interacting with immersive content.
Core Features:
-
Volumetric Rendering and Full Parallax: Our system captures a 3D model of each user in real time, including their facial expressions, gestures, and body movements. This data is sent to the other side via a high-speed network, where it is rendered in real time using volumetric rendering and full parallax support through head tracking. This results in a breathtakingly realistic experience, where users can perceive depth and subtle movements with unparalleled fidelity.
-
Shared Virtual World and Content: Our system enables remote users to not only see each other but also interact with shared virtual spaces and immersive content. Users can share multimedia files, virtual objects, or even play games together within a virtual interaction volume centered on both their displays. This fosters a sense of shared presence and collaboration, eliminating the limitations of traditional communication tools.
-
Autostereoscopic Displays for Enhanced Depth Perception: To further enhance the immersion, our system supports autostereoscopic displays, which do not require special glasses or headsets. These displays allow users to perceive depth without the encumbrance of additional devices, creating an even more natural and engaging experience.
-
Fully Autonomous RGBD Sensing Device: To enable seamless and scalable telepresence, we have developed a fully autonomous RGBD sensing device. Several devices can be interconnected and synchronized for higher fidelity.
Our immersive telepresence solution has the potential to revolutionize the way we communicate and interact with each other. It will transform remote meetings, educational sessions, and even social interactions, making them feel more natural, engaging, and productive. Additionally, our fully autonomous RGBD sensing device will enable the development of truly decentralized telepresence networks, breaking down geographical barriers and fostering a more connected world.
Our project has already produced significant outcomes, including:
-
Prototypes: We have developed working prototypes of our immersive telepresence system, showcasing the capabilities of our technology.
-
Software Stacks and API: We have created comprehensive software stacks and APIs that enable developers to integrate our technology into their applications.
Our immersive telepresence solution represents a paradigm shift in the way we connect with the world around us. By combining cutting-edge technologies with a user-centric approach, we are creating a truly immersive and transformative experience that will fundamentally change the way we communicate, learn, and interact with each other.