In the future, the use of large UHD displays, AR/VR devices, 3D displays, haptic devices, and other emerging devices capable of providing immersive experiences will be widespread among users. The ways in which users engage with programs and content will be even more diverse than they are now (Fig. 1). Therefore, we believe that the media will evolve along a new axis, “expressive space”, as well as along the traditional axes of quality and functionality (Fig. 2), through the use of these various display devices.
In light of this, NHK STRL is envisioning and conducting research on “Diverse Vision”, the future media that will enable anyone to view and experience contents that are appropriate to their circumstances and to the devices that they are using. Through Diverse Vision, users can experience worlds that they have not yet seen and deepen bonds with friends and family, with the full assurance of safety and peace of mind provided by trusted information.
To enable diverse forms of expression for program producers and different ways to enjoy content for viewers, a variety of information on each subject will be acquired and used for program production. To that end, “meta-studio” technologies will be developed (Fig. 3), in which images and sound are not merely shot and recorded, respectively, but in which detailed information on the subject’s shape in 3D, its texture, touch, and resonance of voice and sound is acquired. 3D modelling and spatial processing technologies will evolve to present images and sound fields in advanced ways. In addition, AI technology will be proactively introduced to simplify or automate the production of high-quality content.