Immersive program experience using AR technology
About
We are conducting research and development on technologies to transmit 3D spatial data, such as 3D models and spatial positioning data, and technologies for object-based audio, to implement new experiences that exceed the framework of conventional television.
Streaming transmission of 3D spatial information
Each object comprising the content, such as the performers or instruments, are streamed as independent data. This enables operations such as changing the data transmission time intervals for each object from the transmitting side, easily discarding data for objects that need not be displayed at the receiving side, or customizing the arrangement of objects through user operation.
Linking video and sound using object-based audio technology
Viewing position and direction information is sent from a tablet device to the object-based audio playback equipment, which reproduces the audio so that it sounds natural according to the viewing position and direction. A stronger immersive sense is produced by linking the audio with the free-viewpoint video, according to the movement of the tablet device.