OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 22, Iss. 2 — Feb. 1, 2005
  • pp: 217–229

Image-based face recognition under illumination and pose variations

Shaohua Kevin Zhou and Rama Chellappa  »View Author Affiliations


JOSA A, Vol. 22, Issue 2, pp. 217-229 (2005)
http://dx.doi.org/10.1364/JOSAA.22.000217


View Full Text Article

Enhanced HTML    Acrobat PDF (1267 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We present an image-based method for face recognition across different illuminations and poses, where the term image-based means that no explicit prior three-dimensional models are needed. As face recognition under illumination and pose variations involves three factors, namely, identity, illumination, and pose, generalizations in all these three factors are desired. We present a recognition approach that is able to generalize in the identity and illumination dimensions and handle a given set of poses. Specifically, the proposed approach derives an identity signature that is illumination- and pose-invariant, where the identity is tackled by means of subspace encoding, the illumination is characterized with a Lambertian reflectance model, and the given set of poses is treated as a whole. Experimental results using the Pose, Illumination, and Expression (PIE) database demonstrate the effectiveness of the proposed approach.

© 2005 Optical Society of America

OCIS Codes
(100.5010) Image processing : Pattern recognition
(150.2950) Machine vision : Illumination

History
Original Manuscript: January 6, 2004
Revised Manuscript: June 16, 2004
Manuscript Accepted: September 9, 2004
Published: February 1, 2005

Citation
Shaohua Kevin Zhou and Rama Chellappa, "Image-based face recognition under illumination and pose variations," J. Opt. Soc. Am. A 22, 217-229 (2005)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-22-2-217


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. W. Zhao, R. Chellappa, A. Rosenfeld, J. Phillips, “Face recognition: a literature survey,” ACM Comput. Surv. 12, 399–458 (2003). [CrossRef]
  2. P. Phillips, H. Moon, S. Rizvi, P. Rauss, “The FERET evaluation methodology for face-recognition algorithms,” IEEE Trans. Pattern Anal. Mach. Intell. 22, 1090–1104 (2000). [CrossRef]
  3. R. Basri, D. Jacobs, “Lambertian reflectance and linear subspaces,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 218–233 (2003). [CrossRef]
  4. A. Georghiades, P. Belhumeur, D. Kriegman, “From few to many: illumination cone models for face recognition under variable lighting and pose,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 643–660 (2001). [CrossRef]
  5. A. Shashua, T. R. Raviv, “The quotient image: class based re-rendering and recognition with varying illumination,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 129–139 (2001). [CrossRef]
  6. A. Yuille, D. Snow, R. Epstein, P. Belhumeur, “Determining generative models for objects under varying illumination: shape and albedo from multiple images using SVD and integrability,” Int. J. Comput. Vision 35, 203–222 (1999). [CrossRef]
  7. S. Zhou, R. Chellappa, D. Jacobs, “Characterization of human faces under illumination variations using rank, integrability, and symmetry constraints,” in Proceedings of the European Conference on Computer Vision (Springer-Verlag, Berlin, 2004), Vol. 1, pp. 588–601.
  8. V. Blanz, T. Vetter, “Face identification across different poses and illumination with a 3D morphable model,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1063–1074 (2003). [CrossRef]
  9. P. Fua, “Regularized bundle adjustment to model heads from image sequences without calibrated data,” Int. J. Comput. Vision 38, 153–157 (2000). [CrossRef]
  10. A. Roy Chowdhury, R. Chellappa, “Face reconstruction from video using uncertainty analysis and a generic model,” Comput. Vision Image Underst. 91, 188–213 (2003). [CrossRef]
  11. Y. Shan, Z. Liu, Z. Zhang, “Model-based bundle adjustment with application to face modeling,” in Proceedings of the IEEE International Conference on Computer Vision (IEEE Press, Piscataway, N.J., 2001), Vol. 2, pp. 644–651.
  12. A. Laurentini, “The visual hull concept for silhouette-based image understanding,” IEEE Trans. Pattern Anal. Mach. Intell. 16, 150–162 (1994). [CrossRef]
  13. M. Levoy, P. Hanrahan, “Light field rendering,” in Proceedings of SIGGRAPH ( www.siggraph.org , 1996), pp. 31–42.
  14. W. Matusik, C. Buehler, R. Raskar, S. Gortler, L. McMillan, “Image-based visual hulls,” in Proceedings of SIGGRAPH ( www.siggraph.org , 2000), pp. 369–374.
  15. G. Qian, R. Chellappa, “Structure from motion using sequential Monte Carlo methods,” in Proceedings of the IEEE International Conference on Computer Vision (IEEE Press, Piscataway, N.J., 2001), Vol. 2, pp. 614–621.
  16. S. J. Gortler, R. Grzeszczuk, R. Szeliski, M. Cohen, “The lumigraph,” in Proceedings of SIGGRAPH ( www.siggraph.org , 1996), pp. 43–54.
  17. A. Roy Chowdhury, R. Chellappa, “Stochastic approximation and rate distortion analysis for robust structure and motion estimation,” Int. J. Comput. Vis. 55, 27–53 (2003). [CrossRef]
  18. M. Kirby, L. Sirovich, “Application of Karhunen–Loeve procedure of the characterization of human faces,” IEEE Trans. Pattern Anal. Mach. Intell. 12, 103–108 (1990). [CrossRef]
  19. M. Turk, A. Pentland, “Eigenfaces for recognition,” J. Cogn Neurosci. 3, 72–86 (1991). [CrossRef]
  20. R. Gross, I. Matthews, S. Baker, “Eigen light-fields and face recognition across pose,” in Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (IEEE Press, Piscataway, N.J., 2002), pp. 3–9.
  21. R. Gross, I. Matthews, S. Baker, “Fisher light-fields for face recognition across pose and illumination,” in Proceedings of the 24th Symposium of the German Association for Pattern Recognition (DAGM) (Springer-Verlag, Berlin, 2002), pp. 481–489.
  22. T. Sim, S. Baker, M. Bsat, “The CMU pose, illumination, and expression (PIE) database,” in Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (IEEE Press, Piscataway, N.J., 2002), pp. 53–58.
  23. S. Zhou, R. Chellappa, “Rank constrained recognition under unknown illumination,” in IEEE International Workshop on Analysis and Modeling of Faces and Gestures (IEEE Press, Piscataway, N.J., 2003), pp. 11–18.
  24. A. Shashua, “On photometric issues in 3D visual recognition from a single 2D image,” Int. J. Comput. Vision 21, 99–122 (1997). [CrossRef]
  25. A. Pentland, B. Moghaddam, T. Starner, “View-based and modular eigenspaces for face recognition,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (IEEE Computer Society, Los Alamitos, Calif., 1994), pp. 84–91.
  26. M. A. O. Vasilescu, D. Terzopoulos, “Multilinear analysis of image ensembles: tensorfaces,” in European Conference on Computer Vision (Springer-Verlag, Berlin, 2002), Vol. 1, pp. 447–460.
  27. S. Romdhani, T. Vetter, “Efficient, robust and accurate fitting of a 3D morphable model,” in Proceedings of the IEEE International Conference on Computer Vision (IEEE Press, Piscataway, N.J., 2003), pp. 59–66.
  28. A. Lanitis, C. J. Taylor, T. F. Cootes, “Automatic interpretation and coding of face images using flexible models,” IEEE Trans. Pattern Anal. Mach. Intell. 19, 743–756 (1997). [CrossRef]
  29. T. Vetter, T. Poggio, “Linear object classes and image synthesis from a single example image,” IEEE Trans. Pattern Anal. Mach. Intell. 19, 733–742 (1997). [CrossRef]
  30. In our current implementation, the L vector is not completely shape free, since we use a simple normalization operation.
  31. W. T. Freeman, J. B. Tenenbaum, “Learning bilinear models for two-factor problems in vision,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (IEEE Computer Society, Los Alamitos, Calif., 1997), pp. 554–560.
  32. M. Brand, “Incremental singular value decomposition of uncertain data with missing values,” in European Conference on Computer Vision (Springer-Verlag, Berlin, 2002), Vol. 1, pp. 707–720.
  33. H. Gupta, “Contour based 3D face modeling from monocular video,” M.S. dissertation (University of Maryland, College Park, Md., 2003).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited