A new algorithm is proposed for face recognition by a Bayesian framework. Posterior distributions are computed by Markov chain Monte Carlo (MCMC). Face features used in the paper are those used in our previous work  based on the Elastic Graph Matching method. While our previous method attempts to optimize facial feature point positions so as to maximize a similarity function between each model and face region in the input sequence, the proposed approach evaluates posterior distributions of models conditioned on the input sequence. Experimental results show a rather dramatic improvement in robustness. The proposed algorithm eliminates almost all identification errors on sequences showing individuals talking, and reduces identification errors by more than 90% on sequences showing individuals smiling although such data was not used in training.
To appear in Proceedings of ICPR2004, Cambridge, 23-26 August 2004
||4.0%(32 / 796)||0.0%(0 / 796)|
|Talking||8.2%(121 / 1483)||0.1%(1 / 1483)|
|Smiling||37.4%(461 / 1233)||2.6%(32 / 1233)|
|TOTAL||17.5%(614 / 3512)||0.9%(33 / 3512)|
|proc.time*||3 min.||50 min.|
|To evaluate the sensitivity of the approach to errors at the preceding face detection stage, we performed a numerical simulation of a noisy face detector. Tables 2, 3 and 4 show the recognition results when face regions were dilated , horizontally shifted and vertically shifted . We skipped 9 of every 10 MCMC samples to reduce the total processing time.|
|proc. time *||5 min.|
|proc. time*||5 min.|
|proc. time*||5 min.|
|||Clippingdale, S. and Ito, T., "A Unified Approach to Video Face Detection, Tracking and Recognition," Proc. ICIP′99, Kobe, Japan, 1999, pp.662-666.|
|||Clippingdale, S. and Ito, T., "Partial automation of database acquisition in the FAVRET face tracking and recognition system using a bootstrap approach," Proc. MVA2000, Tokyo, Japan, 2000, pp.5-8.|
|||Wiskott, L., Fellous, J-M., Krüger, N., and von der Malsburg, C., "Face Recognition by Elastic Bunch Graph Matching," Technical Report IR-INI 96-08, Institut für Neuroinformatik, Ruhr-Universitšt Bochum, 1996.|
|||Okada, K., Steffens, J., Maurer, T., Hong, H., Elagin, E., Neven, H., and von der Malsburg, C., "The Bochum/USC Face Recognition System And How it Fared in the FERET Phase III Test," Face Recognition: From Theory to Applications, Springer, 1998.|
|||Ekman,P. and Friesen,W.V., Unmasking the Face, Prentice-Hall,Inc.,Englewood Cliffs, 1975.|
|||MacKay, D. J. C., Information Theory, Inference, and Learning Algorithms, Cambridge University Press, 2003.|
|||Neal, R. M., Bayesian Learning for Neural Networks, Springer, 1996.|
|||Neal, R. M., "Annealed Importance Sampling," Technical Report 9805, Dept. of Statistics, Univ. of Toronto, 1998.|
|||Doucet, A., Freitas, N. de, and Gordon, N., Sequential Monte Carlo Methods in Practice, Springer, 2001.|
|||Lampinen, J., Tamminen, T., Kostiainen, T., and Kalliomaki, I., "Bayesian object matching based on MCMC sampling and Gabor filters," Proc. SPIE Intelligent Robots and Computer Vision XX: Algorithms, Techniques, and Active Vision, 2001, Vol.4572 pp.41-50.|
| Mr. Atsushi Matsui
Atsushi Matsui received the B.E. and M.E. degrees in Electrical Engineering from Waseda University, Tokyo, Japan in 1994 and 1996 respectively. He joined Japan Broadcasting Corporation (NHK) in 1996. Since 1998, he has been with NHK Science and Technical Research Laboratories, engaged in research on speech recognition and face recognition. He is a member of the Institute of Electronics, Information and Communication Engineers (IEICE) and the Institute of Image Information and Television Engineers of Japan (ITE).
|Mr. Simon Clippingdale
Simon Clippingdale received the B.Sc. Honours degree in Electronic and Electrical Engineering in 1982 from the University of Birmingham, U.K. and the Ph.D. degree in Computer Science in 1988 from the University of Warwick, U.K. He was a Japanese Government Science & Technology Agency (STA) Research Fellow at NHK Science and Technical Research Laboratories in 1990-91, and after lecturing at the University of Warwick, joined NHK in 1996. Since then he has been with NHK Science and Technical Research Laboratories, pursuing research on image recognition and vision. He is currently a Senior Research Engineer, and is a member of the Institute of Electronics, Information and Communication Engineers (IEICE) and the Institute of Image Information and Television Engineers of Japan (ITE). He currently serves on the IEICE Technical Committee on Pattern Recognition and Media Understanding.
|Mr. umiki Uzawa
Fumiki Uzawa received the B.E. degree in Electrical, Electronics and Computer Engineering from Waseda University, Tokyo, Japan, in 2004. His research interests include face recognition and image processing. He joined Japan Broadcasting Corporation (NHK) in 2004. Since then he has been with NHK Okayama Broadcasting Station. He is a member of the Institute of Electronics, Information and Communication Engineers (IEICE) .
|Mr. Takashi Matusmoto
Takashi Matsumoto received a B.S. degree in Electrical Engineering from Waseda University, Tokyo, Japan, a M. Sc. degree in Applied Mathematics from Harvard University, Cambridge, MA, and a Ph.D. degree in Electrical Engineering from Waseda University. Since 1980, he has been a Professor at Waseda University, Tokyo, Japan. Currently, Dr. Matsumoto is with the Signal Processing Group, Cambridge University, U.K., on leave from Waseda University. His research interests include Monte Carlo based hierarchical Bayesian algorithms, Particle Filters, MCMC, on-line signature verification, on-line face recognition, on-line handwriting recognition, non-linear time series prediction, and bioinformatics. He is on the editorial board of Circuits, Systems, and Signal Processing. He is a coauthor of the book Bifurcations (Springer-Verlag, 1993). Dr. Matsumoto is a past Editorial Board Member, as well as a guest coeditor of the Proceedings of the IEEE. He is a member of the IEICE Biometric Person Authentication Technical Committee as well as a member of the ITE Technical Committee on Next-Generation Image Input Devices. He serves as a member of the Steering Committee of SVC 2004, Signature Verification Competition. He is a fellow of the IEEE.