AbstractWe have developed a novel high-definition version of a three-dimensional camera (an HDTV version of an Axi-vision camera) that can simultaneously capture both the HDTV colour image and the depth image of a scene at a video frame rate. The depth image is obtained by using intensity-modulated illuminators with a near-infrared spectrum combined with a high-resolution camera with an ultra-fast shutter using an image intensifier. A high signal-to-noise ratio of the depth image, which is necessary to realize this HDTV version of the Axi-vision camera, has been achieved by (1) a new highly sensitive image intensifier, (2) novel optics, and (3) high power light emitting diode array illuminators. As a result, the camera can capture a depth image with more than 920,000 pixels at a frame rate of 29.97 Hz or one with 410,000 pixels at a frame rate of 59.94 Hz. Such high performance makes this camera suitable for practical applications such as post-production in a virtual studio where images of objects at a specific distance can be selectively extracted and synthesized with other images in real time.
|Average light power||1||[W]|
|Modulation frequency||10 to 50||[MHz]|
|Image intensifier||Gate time||1 to 20||[ns]|
|Repetition rate||10 to 50||[MHz]|
|Number of effective pixels
||1280(H)||720 (V) (29.97 Hz)|
|853(H)||480 (V) (59.94 Hz)|
|Depth image||Depth resolution
(at 2 m distance)
 R. A. Jarvis, "A laser time-of-flight range scanner for robotic vision," IEEE Trans., Vol. PAMI-5, No. 5, pp.505-512, 1983.
 M. Rioux, "Laser range finder based on synchronized scanners," Applied Optics, Vol. 23, pp. 3837-3844, 1984.  S. Inokuchi, Y. Morita, and Y. Sakurai, "Optical pattern processing utilizing nematic liquid crystals," Applied Optics, Vol.11, pp.2223-2227, 1972.
 S. Kimura, H. Kano, T. Kanade, A. Yoshida, E. Kawamura, and K. Oda, "CMU video-rate stereo machine," in Proceedings of 1995 Mobile Mapping Symposium (American Society for Photogrammetry and Remote Sensing, Columbus, Ohio) pp.9-18, 1995.
 H. Takasaki, "Moire topography," Applied Optics, Vol.9, pp.1467-1472, 1970.
 M. Kawakita, K. Iizuka, H. Kikuchi, H. Fujikake, J. Yonai, and T. Aida, "A 3D camera system using a high-speed shutter and intensity modulated illuminator," (in Japanese) Institute of image information and television engineers (ITE) Tech. Rep., Vol.22, No.57, pp.19-24, 1998.
 M. Kawakita, K. Iizuka, T. Aida, H. Kikuchi, H. Fujikake, J. Yonai, and K. Takizawa, Axi-vision camera (Real-Time Depth- Mapping Camera), Applied Optics, Vol.39, pp.3931-3939, 2000.
 M. Kawakita, K. Iizuka, T. Aida, H. Kikuchi, H. Fujikake, J. Yonai, and K. Takizawa, "Axi- vision camera: a three-dimension camera," Proc. SPIE, Vol.3958, pp. 61-70, 2000.  Y. Yamanouchi, H. Mitsumine, and S. Inoue, "Image-based Virtual Studio using Ultra High-definition Omnidirectional Images," (in Japanese) The Journal of the institute of image information and television engineers, Vol.55, pp.159-166, 2001.
Masahiro Kawakita received his B.S. and M.S. degrees in physics from Kyushu University in 1988 and 1990, respectively. He joined the Japan Broadcasting Corporation (NHK), Tokyo, Japan, in 1990. Since 1993, he has been with NHK Science & Technical Research Laboratories, and engaged in research on liquid crystal devices, optically addressed spatial modulators, and 3D cameras.
Mr. Kawakita is a member of the Optical Society of America, the Japan Society of Applied Physics, and The Institute of Image Information and Television Engineers of Japan.
Taiichro Kurita completed his M. E. and Ph. D. degrees at Keio Gijuku University in 1980 and 1991, respectively. He joined NHK (Japan Broadcasting Corporation) in 1980. He began work in 1982 at NHK Science and Technical Research Laboratories, on research relating to television systems and signal processing of moving pictures (including HDTV, EDTV, etc.) and research on display methods and picture quality on PDPs and LCDs. Beginning in 1993, he had also held a visiting associate professorship at the University of Electro-Communications until 2000. He is the senior research engineer of Display and Optical Devices Division in the NHK laboratories.
Hiroshi Kikuchi received his B.E. and M.E. degrees from Toyohashi University of Technology, Toyohashi, Japan, in 1982 and 1984, respectively.
In 1984, he joined NHK (Japan Broadcasting Corporation), Tokyo, and worked as a broadcasting engineer at the Kobe Broadcasting Station. Since 1987, he has been at the Science & Technical Research Laboratories of NHK, where he has been engaged in research on optoelectronic devices, such as spatial light modulators using liquid crystals, optical bistable devices using liquid crystals and semiconductor lasers, and optically addressed projection displays. Mr. Kikuchi is a member of the Japan Society of Applied Physics.
Yuko Yamanouchi received the B. Eng. Degree in electronic engineering from Sophia University in 1986, and the M. Eng. Degree in electronic engineering from Tokyo Institute of Technology in 1988. She joined NHK in 1988. Since 1990 she has been with NHK Science and Technical Research Laboratories, where she has been engaged in research on image processing and computer graphics technique for TV program production and virtual studio systems.
Seiki Inoue got B.S. degree in electrical engineering, M.S. and Ph.D. degrees in electronics engineering all from Univ. of Tokyo in 1978, 1980 and 1992, respectively. He joined NHK in 1980. He worked at ATR Media Integration and Communications Research Labs. from 1995 to 1998. His interest includes image and video processing, computer graphics and virtual studio.
Keigo Iizuka received his Bachelor Degree in Electrical Engineering from Kyoto University in 1955 and his Master and Ph.D. Degrees both from Harvard University in Applied Physics in 1958 and 1961, respectively. He was appointed to Lecturer at Harvard University from 1964 to 1968. He has been a Professor at the University of Toronto, Canada since 1968 to present.
He is a Fellow of Optical Society of America.
He authored following books:
Fundamentals in Engineering Optics from Ohm sha..
Engineering Optics from Kyoritu Shuppan.
Engineering Optics from Spring Verlag.
Elements of Photonics Volume 1 from John Wiley and Sons.
Elements of Photonics Volume 2 from John Wiley and Sons.