Open House 2004 Dreams ON AIR. Welcome to the Future Fantasticjapanese
TOPExhibitionAddressPresentationAccess GuideSTRL HOME
 Open House TOP > Exhibition > Fun Exhibits : 12

BACK  |  NEXT
Fun Exhibits
12 Mixed Reality Audio-Visual Reproduction System
13 High-quality Speech Synthesis
14 TV Agent System Using Gaze Information
15 TV4U (TV for You)
- Automatic Program Generation Technology
16 Multi viewpoint Camera System
17 Free Viewpoint Video Representation Technology
18 Integral 3-D Television
19 Vintage Broadcasting Equipment
20 Latest HDTV Broadcasting Equipments

Vision Exhibits

Technical Exhibits
12
Mixed Reality Audio-Visual Reproduction System
  Background and Objectives
  One of the future broadcasting services will be an interactive service in which viewers can select their audio video presentation preferences by specifying a viewpoint location. We are studying how to control ambience and the localization of a sound image dynamically linked to the composition of a 3-D video image. To examine the synergy with 3-D video, we constructed an experimental system (MRAV*1) that can automatically reproduce virtual 3-D sound linked to the viewpoint of 3-D CGs.
  Features
  • The sound image distance is controlled with small loudspeaker arrays*2.
  • Three front loudspeaker arrays are driven by two signals, from distant sounds and close sounds, employing a total of eight channels including the two rear loudspeakers. When the front loudspeaker arrays emit the sum of the distant and close sound signals, the system can be in 5.1 channel surround sound.
  • It transmits video frame identification numbers to the sound system side, to accurately time the video and sound signals.
  • We constructed a display program that composes high-resolution stereoscopic video.
  Future Work
 The synergy of three-dimensional video and audio will lead to a system conveying a strong sensation of presence.
 *1 MRAV (Mixed Reality Audio-Visual reproduction System)
 *2 Loudspeaker array: loudspeaker consists of many loudspeaker units arranged for focusing.

System Flowchart
Copyright (C) 2004 NHK (Japan Broadcasting Corporation) All rights reserved. Unauthorized copy of the pages is prohibited.