OSA's Digital Library

Applied Optics

Applied Optics


  • Vol. 42, Iss. 29 — Oct. 10, 2003
  • pp: 5882–5890

Pose estimation from a two-dimensional view by use of composite correlation filters and neural networks

Albertina Castro, Yann Frauel, Eduardo Tepichín, and Bahram Javidi  »View Author Affiliations

Applied Optics, Vol. 42, Issue 29, pp. 5882-5890 (2003)

View Full Text Article

Enhanced HTML    Acrobat PDF (849 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



We present a technique to estimate the pose of a three-dimensional object from a two-dimensional view. We first compute the correlation between the unknown image and several synthetic-discriminant-function filters constructed with known views of the object. We consider both linear and nonlinear correlations. The filters are constructed in such a way that the obtained correlation values depend on the pose parameters. We show that this dependence is not perfectly linear, in particular for nonlinear correlation. Therefore we use a two-layer neural network to retrieve the pose parameters from the correlation values. We demonstrate the technique by simultaneously estimating the in-plane and out-of-plane orientations of an airplane within an 8-deg portion. We show that a nonlinear correlation is necessary to identify the object and also to estimate its pose. On the other hand, linear correlation is more accurate and more robust. A combination of linear and nonlinear correlations gives the best results.

© 2003 Optical Society of America

OCIS Codes
(100.5010) Image processing : Pattern recognition
(100.6740) Image processing : Synthetic discrimination functions
(200.4260) Optics in computing : Neural networks

Original Manuscript: January 30, 2003
Revised Manuscript: June 2, 2003
Published: October 10, 2003

Albertina Castro, Yann Frauel, Eduardo Tepichín, and Bahram Javidi, "Pose estimation from a two-dimensional view by use of composite correlation filters and neural networks," Appl. Opt. 42, 5882-5890 (2003)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. T. Horprasert, Y. Yacoob, L. S. Davis, “Computing 3D head orientation from a monocular image sequence,” in 25th AIPR Workshop: Emerging Application of Computer Vision, D. H. Schaefer, E. F. Williams, eds., Proc. SPIE2962, 244–252 (1997). [CrossRef]
  2. H. Wu, T. Fukumoto, Q. Chen, M. Yachida, “Face detection and rotations estimation using color information,” in Proceedings of the Fifth IEEE International Workshop on Robot and Human Communication (Institute of Electrical and Electronics Engineers, New York, 1996), pp. 341–346.
  3. I. Shimizu, Z. Zhang, S. Akamatsu, K. Deguchi, “Head pose determination from one image using a generic model,” Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition (Institute of Electrical and Electronics Engineers, New York, 1998), pp. 100–105. [CrossRef]
  4. W. Wilson, “Visual servo control of robots using Kalman filter estimates of robot pose relative to work-pieces,” in Visual Serving, K. Hashimoto, ed. (Word Scientific, Singapore, 1994), pp. 71–104.
  5. M. Bajura, H. Fuchs, R. Ohbuchi, “Merging virtual objects with the real world: seeing ultrasound imagery within the patient,” Comput. Graph. 26, 203–210 (1992). [CrossRef]
  6. N. Ezquerra, R. Mullick, “An approach to 3D pose determination,” ACM Trans. Graphics 15, 99–120 (1996). [CrossRef]
  7. G. H. Rosenfield, “The problem of exterior orientation in photogrammetry,” Photogramm. Eng. 25, 536–553 (1959).
  8. R. M. Haralick, C.-N. Lee, K. Ottenberg, M. Nolle, “Review and analysis of solutions of the three point perspective pose estimation problem,” Int. J. Comput. Vision 13, 331–56 (1994). [CrossRef]
  9. C.-P. Lu, G. D. Hager, E. Mjolsness, “Fast and globally convergent pose estimation from video images,” IEEE Trans. Pattern Anal. Mach. Intell. 22, 610–622 (2000). [CrossRef]
  10. D. P. Huttenlocher, S. Ullman, “Recognizing solid objects by alignment with an image,” Int. J. Comput. Vision 5, 195–212 (1990). [CrossRef]
  11. S. E. Monroe, R. D. Juday, “Multidimensional synthetic estimation filter,” in Optical Information Processing Systems and Architectures II, B. Javidi, ed., Proc. SPIE1347, 179–185 (1990). [CrossRef]
  12. L. G. Hassebrook, M. E. Lhamon, M. Wang, J. P. Chatterjee, “Postprocessing of correlation for orientation estimation,” Opt. Eng. 36, 2710–2718 (1997). [CrossRef]
  13. F. Dubois, “Nonredundant filters for pattern recognition and orientation estimation of rotated images,” Appl. Opt. 30, 1388–1395 (1991). [CrossRef] [PubMed]
  14. B. V. K. Vijaya Kumar, A. J. Lee, J. M. Connelly, “Correlation filters for orientation estimation,” in Digital and Optical Shape Representation and Pattern Recognition, Proc. SPIE938, 190–197 (1988). [CrossRef]
  15. H. J. Caulfield, W. T. Maloney, “Improved discrimination in optical character recognition,” Appl. Opt. 8, 2354–2356 (1969). [CrossRef] [PubMed]
  16. H. J. Caulfield, “Linear combinations of filters for character recognition: a unified treatment,” Appl. Opt. 19, 3877–3879 (1980). [CrossRef] [PubMed]
  17. C. F. Hester, D. Casasent, “Multivariant technique for multiclass pattern recognition,” Appl. Opt. 19, 1758–1761 (1980). [CrossRef] [PubMed]
  18. D. Casasent, “Unified synthetic discriminant function computational formulation,” Appl. Opt. 23, 1620–1627 (1984). [CrossRef] [PubMed]
  19. B. Javidi, J. Wang, “Optimum distortion-invariant filter for detecting a noisy distorted target in nonoverlapping background noise,” J. Opt. Soc. Am. A 12, 2604–2614 (1995). [CrossRef]
  20. A. Mahalanobis, “Review of correlation filters and their application for scene matching,” in Optoelectronic Devices and Systems for Processing, B. Javidi, Kristina M. Johnson, eds., in Vol. CR65 of SPIE Critical Review Series (SPIE, Bellingham, Wash., 1996), pp. 240–260.
  21. A. Mahalanobis, “Correlation filters for object tracking, target reacquisition, and smart aim-point selection,” in Optical Pattern Recognition VIII, D. P. Casasent, T.-H. Chao, eds., Proc. SPIE3073, 25–32 (1997). [CrossRef]
  22. R. Beale, T. Jackson, Neural Computing: An Introduction (Institute of Physics, Bristol, UK, 1992).
  23. D. E. Rumelhart, G. E. Hinton, R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing, D. E. Rumelhart, J. L. McClelland, eds. (MIT, Cambridge, Mass., 1986).
  24. M. T. Hagan, M. Menhaj, “Training feedforward networks with the Marquardt algorithm,” IEEE Trans. Neural Netw. 5, 989–993 (1994). [CrossRef] [PubMed]
  25. B. Javidi, D. Painchaud, “Distortion-invariant pattern recognition with Fourier-plane nonlinear filters,” Appl. Opt. 35, 318–331 (1996). [CrossRef] [PubMed]
  26. S. Hong, B. Javidi, “Optimum nonlinear composite filter for distortion-tolerant pattern recognition,” Appl. Opt. 41, 2172–2178 (2002). [CrossRef] [PubMed]
  27. P. Réfrégier, V. Laude, B. Javidi, “Nonlinear joint-transform correlation: an optimal solution for adaptive image discrimination and input noise robustness,” Opt. Lett. 19, 405–407 (1994). [PubMed]
  28. B. Javidi, “Nonlinear joint power spectrum based optical correlation,” Appl. Opt. 28, 2358–2367 (1989). [CrossRef] [PubMed]
  29. K. R. Castleman, “Pattern recognition: image segmentation,” in Digital Image Processing (Prentice-Hall, Upper Saddle River, N.J., 1996), pp. 447–485.
  30. R. M. Haralick, L. M. Shapiro, “Survey: image segmentation,” Comput. Vision Graph. Image Process. 29, 100–132 (1985). [CrossRef]
  31. C. Chesnaud, P. Réfrégier, V. Boulet, “Statistical region snake-based segmentation adapted to different physical noise model,” IEEE Trans. Pattern Anal. Mach. Intell. 21, 1145–1157 (1999). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited