Bringing metadata into the video production system
The system analyses the video material and automatically generates metadata such as image features and the name of the subject, thereby making it easier to search for particular images. By using video analysis and light-sensing technologies, it also automatically generates more technical information, such as camera movements and lighting data, which are essential for sophisticated video production.
The video composition process needs information on camera movements, lighting, subject region, etc. The system uses data from sensor cameras* to automatically generate lighting information for making more natural-looking video compositions.
We will continue to improve each of the elemental technologies, conduct trials in which we work closely with production teams, and build on their feedback to create a versatile and practical system.
* Sensor camera: a camera used to capture information about lighting conditions such as locations, intensities, and colors of light sources.