OSA's Digital Library

Applied Optics

Applied Optics


  • Vol. 40, Iss. 20 — Jul. 10, 2001
  • pp: 3318–3325

Real-time three-dimensional object recognition with multiple perspectives imaging

Osamu Matoba, Enrique Tajahuerce, and Bahram Javidi  »View Author Affiliations

Applied Optics, Vol. 40, Issue 20, pp. 3318-3325 (2001)

View Full Text Article

Enhanced HTML    Acrobat PDF (2002 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



A novel system for recognizing three-dimensional (3D) objects by use of multiple perspectives imaging is proposed. A 3D object under incoherent illumination is projected into an array of two-dimensional (2D) elemental images by use of a microlens array. Each elemental 2D image corresponds to a different perspective of the 3D object. Multiple perspectives imaging based on integral photography has been used for 3D display. In this way, the whole set of 2D elemental images records 3D information about the input object. After an optical incoherent-to-coherent conversion, an optical processor is employed to perform the correlation between the input and the reference 3D objects. Use of micro-optics allows us to process the 3D information in real time and with a compact optical system. To the best of our knowledge this 3D processor is the first to apply the principle of integral photography to 3D image recognition. We present experimental results obtained with both a digital and an optical implementation of the system. We also show that the system can recognize a slightly out-of-plane rotated 3D object.

© 2001 Optical Society of America

OCIS Codes
(100.4550) Image processing : Correlators
(100.5010) Image processing : Pattern recognition
(100.6890) Image processing : Three-dimensional image processing
(200.4740) Optics in computing : Optical processing

Original Manuscript: September 5, 2000
Revised Manuscript: January 12, 2001
Published: July 10, 2001

Osamu Matoba, Enrique Tajahuerce, and Bahram Javidi, "Real-time three-dimensional object recognition with multiple perspectives imaging," Appl. Opt. 40, 3318-3325 (2001)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. A. VanderLught, “Signal detection by complex matched spatial filtering,” IEEE Trans. Inf. Theory IT-10, 139–145 (1964).
  2. C. S. Weaver, J. W. Goodman, “Technique for optically convolving two functions,” Appl. Opt. 5, 1248–1249 (1966). [CrossRef] [PubMed]
  3. Ph. Réfrégier, “Filter design for optical pattern recognition: multicriteria optimization approach,” Opt. Lett. 15, 854–856 (1990). [CrossRef] [PubMed]
  4. A. D. McAulay, Optical Computer Architectures (Wiley, New York, 1991).
  5. A. Mahalanobis, “Review of correlation filters and their application for scene matching,” in Optoelectronic Devices and Systems for Processing, B. Javidi, K. M. Johnson, eds., Vol. CR65 of SPIE Critical Reviews of Optical Science and Technology (SPIE Press, Bellingham, Wash., 1996), pp. 240–260.
  6. J. W. Goodman, Introduction to Fourier Optics (McGraw-Hill, New York, 1996).
  7. A. Pu, R. Denkewalter, D. Psaltis, “Real-time vehicle navigation using a holographic memory,” Opt. Eng. 36, 2737–2746 (1997). [CrossRef]
  8. J. Rosen, “Three-dimensional optical Fourier transform and correlation,” Opt. Lett. 22, 964–966 (1997). [CrossRef] [PubMed]
  9. B. Javidi, E. Tajahuerce, “Three-dimensional object recognition by use of digital holography,” Opt. Lett. 25, 610–612 (2000). [CrossRef]
  10. J. J. Esteve-Taboada, D. Mas, J. García, “Three-dimensional object recognition by Fourier transform profilometry,” Appl. Opt. 38, 4760–4765 (1999). [CrossRef]
  11. H. J. Caulfield, ed., Handbook of Optical Holography (Academic, London, 1979).
  12. F. Okano, H. Hoshino, J. Arai, I. Yuyama, “Real-time pickup method for a three-dimensional image based on integral photography,” Appl. Opt. 36, 1598–1603 (1997). [CrossRef] [PubMed]
  13. F. Okano, Jun Arai, H. Hoshino, I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38, 1072–1077 (1999).
  14. B. Javidi, “Nonlinear joint transform correlators,” in Real-Time Optical Information Processing, B. Javidi, J. L. Horner eds. (Academic, San Diego, Calif., 1994), Chap. 4, pp. 115–183.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited