OSA's Digital Library

Optics Express

Optics Express

  • Editor: C. Martijn de Sterke
  • Vol. 15, Iss. 4 — Feb. 19, 2007
  • pp: 1513–1533

Three-dimensional distortion-tolerant object recognition using photon-counting integral imaging

Seokwon Yeom, Bahram Javidi, and Edward Watson  »View Author Affiliations

Optics Express, Vol. 15, Issue 4, pp. 1513-1533 (2007)

View Full Text Article

Enhanced HTML    Acrobat PDF (896 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



This paper addresses three-dimensional distortion-tolerant object recognition using photon-counting integral imaging (II). A photon-counting linear discriminant analysis (LDA) is proposed for classification photon-limited images. In the photon-counting LDA, classical irradiance images are used to train the classifier. The unknown objects used to test the classifier are labeled by the number of photons detected. The optimal solution of the Fisher’s LDA for photon-limited images is found to be different from the case when irradiance values are used. This difference results in one of the merits of a photon-counting LDA, namely that the high dimensionality of the image can be handled without preprocessing. Thus, the singularity problem of the Fisher’s LDA encountered in the use of irradiance images can be avoided. By using photon-counting II, we build a compact distortion tolerant recognition system that makes use of the multiple-perspective imaging of II to enhance the recognition performance. Experimental and simulation results are presented to classify out-of-plane rotated objects. The performance is analyzed in terms of mean-squared distance (MSD) between the irradiance images. It is shown that a low level of photons is sufficient in the proposed technique.

© 2007 Optical Society of America

OCIS Codes
(000.0000) General : General
(030.5260) Coherence and statistical optics : Photon counting
(100.5010) Image processing : Pattern recognition
(100.5760) Image processing : Rotation-invariant pattern recognition
(100.6890) Image processing : Three-dimensional image processing
(110.6880) Imaging systems : Three-dimensional image acquisition

ToC Category:
Image Processing

Original Manuscript: November 15, 2006
Revised Manuscript: January 18, 2007
Manuscript Accepted: January 23, 2007
Published: February 19, 2007

Seokwon Yeom, Bahram Javidi, and Edward Watson, "Three-dimensional distortion-tolerant object recognition using photon-counting integral imaging," Opt. Express 15, 1513-1533 (2007)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. A. Mahalanobis and F. Goudail, "Methods for automatic target recognition by use of electro-optic sensors: introduction to the feature issue," Appl. Opt. 43, 207-209 (2004). [CrossRef]
  2. P. Refregier, Noise Theory and Applications to Physics (Springer, 2004).
  3. F. A. Sadjadi, ed., Selected Papers on Automatic Target Recognition (SPIE-CDROM, 1999).
  4. B. Javidi, ed., Image Recognition and Classification: Algorithms, Systems, and Applications (Marcel Dekker, New York, 2002). [CrossRef]
  5. H. Kwon and N. M. Nasrabadi, "Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery," IEEE Trans. Geosci. Remote Sens. 43, 388-397 (2005). [CrossRef]
  6. B. Javidi, ed., Optical Imaging Sensors and Systems for Homeland Security Applications (Springer, NewYork, 2005).
  7. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification 2nd ed. (Wiley Interscience, New York, 2001). [PubMed]
  8. K. Fukunaga, Introduction to Statistical Pattern Recognition 2nd ed. (Academic Press, Boston, 1990). [PubMed]
  9. C. M. Bishop, Neural Networks for Pattern Recognition (Oxford University Press, New York, 1995).
  10. D. L. Swets and J. Weng, "Using discriminant eigenfeatures for image retrieval," IEEE Trans. Pattern. Anal. Mach. Intell. 18, 831-836 (1996). [CrossRef]
  11. P. N. Belhumer, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: recognition using class specific linear projection," IEEE Trans. Pattern. Anal. Mach. Intell. 19, 711-720 (1997). [CrossRef]
  12. O. Matoba, E. Tajahuerce, and B. Javidi, "Real-time three-dimensional object recognition with multiple perspectives imaging," Appl. Opt. 40, 3318-3325 (2001). [CrossRef]
  13. Y. Frauel and B. Javidi, "Digital three-dimensional image correlation by use of computer-reconstructed integral imaging," Appl. Opt. 41, 5488-5496 (2002). [CrossRef] [PubMed]
  14. S. Kishk and B. Javidi, "Improved resolution 3D object sensing and recognition using time multiplexed computational integral imaging," Opt. Express 11, 3528-3541 (2003). [CrossRef] [PubMed]
  15. S. Yeom and B. Javidi, "Three-dimensional distortion tolerant object recognition using integral imaging," Opt. Express 12, 5795-5809 (2004). [CrossRef] [PubMed]
  16. S. Yeom, B. Javidi, and E. Watson, "Photon counting passive 3D image sensing for automatic target recognition," Opt. Express 13, 9310-9330 (2005). [CrossRef] [PubMed]
  17. B. Javidi and F. Okano, eds., Three-dimensional Television, Video, and Display Technologies (Springer, New York, 2002).
  18. J.-S. Jang and B. Javidi, "Time-multiplexed integral imaging for 3D sensing and display," Optics and Photonics News 15, 36-43 (2004). http://www.osa-opn.org/abstract.cfm?URI=OPN-15-4-36.
  19. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, "Real-time pickup method for a three-dimensional image based on integral photography," Appl. Opt. 36, 1598-1603 (1997). [CrossRef] [PubMed]
  20. M. Martínez-Corral, B. Javidi, R. Martínez-Cuenca, and G. Saavedra, "Multifacet structure of observed reconstructed integral images," J. Opt. Soc. Am. A. 22, 597-603 (2005). [CrossRef]
  21. E. Hecht, Optics 4th ed. (Addison Wesley, 2001). [PubMed]
  22. J. W. Goodman, Statistical Optics (Jonh Wiley & Sons Inc., 1985), Chap 9.
  23. G. M. Morris, "Scene matching using photon-limited images," J. Opt. Soc. Am. A. 1, 482-488 (1984). [CrossRef]
  24. G. M. Morris, "Image correlation at low light levels: a computer simulation," Appl. Opt. 23, 3152-3159 (1984). [CrossRef] [PubMed]
  25. E. A. Watson and G. M. Morris, "Comparison of infrared upconversion methods for photon-limited imaging," J. Appl. Phys. 67, 6075-6084 (1990). [CrossRef]
  26. E. A. Watson and G. M. Morris, "Imaging thermal objects with photon-counting detector," Appl. Opt. 31, 4751-4757 (1992). [CrossRef] [PubMed]
  27. M. N. Wernick and G. M. Morris, "Image classification at low light levels" J. Opt. Soc. Am. A. 3, 2179-2187 (1986). [CrossRef]
  28. L. A. Saaf and G. M. Morris, "Photon-limited image classification with a feedforward neural network," Appl. Opt. 34, 3963-3970 (1995). [CrossRef] [PubMed]
  29. D. Stucki, G. Ribordy, A. Stefanov, H. Zbinden, J. G. Rarity, and T. Wall, "Photon counting for quantum key distribution with Peltier cooled InGaAs/InP APDs," J. Mod. Opt. 48, 1967-1981 (2001). [CrossRef]
  30. P. A. Hiskett, G. S. Buller, A. Y. Loudon, J. M. Smith, I Gontijo, A. C. Walker, P. D. Townsend, and M. J. Robertson, "Performance and design of InGaAs/InP photodiodes for single-photon counting at 1.55 um," Appl. Opt. 39, 6818-6829 (2000). [CrossRef]
  31. L. Duraffourg, J.-M. Merolla, J.-P. Goedgebuer, N. Butterlin, and W. Rhods, "Photon counting in the 1540-nm wavelength region with a Germanium avalanche photodiode," IEEE J. Quantum Electron. 37, 75-79 (2001). [CrossRef]
  32. J. G. Rarity, T. E. Wall, K. D. Ridley, P. C. M. Owens, and P. R. Tapster, "Single-photon counting for the 1300-1600-nm range by use of Peltier-cooled and passively quenched InGaAs avalanche photodiodes," Appl. Opt. 39, 6746-6753 (2000). [CrossRef]
  33. M. Guillaume, P. Melon, and P. Refregier, "Maximum-likelihood estimation of an astronomical image from a sequence at low photon levels," J. Opt. Soc. Am. A. 15, 2841-2848 (1998). [CrossRef]
  34. K. E. Timmermann and R. D. Nowak, "Multiscale modeling and estimation of Poisson processes with application to photon-limited imaging," IEEE Trans. Infor. Theor. 45, 846-862 (1999). [CrossRef]
  35. Ph. Refregier, F. Goudail, and G. Delyon, "Photon noise effect on detection in coherent active images," Opt. Lett. 29, 162-164 (2004). [CrossRef] [PubMed]
  36. K-R. Muller, S. Mika, G. Ratsch, K. Tsuda, and B. Scholkopf, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Networks 12, 181-201 (2001). [CrossRef]
  37. A. Ruiz and P. E. Lopez-de-Teruel, "Nonlinear kernel-based statistical pattern analysis," IEEE Trans. Neural Networks 12, 16-32 (2001). [CrossRef]
  38. A. Papoulis, Probability, Random Variables, and Stochastic Processes 3rd ed. (McGraw-Hill, Inc. 1991). [PubMed]
  39. Y. Cheng, Y. Zhuang, and J. Yang, "Optimal Fisher discriminant analysis using the rank decomposition," Patt.Recog. 25, 101-111 (1992). [CrossRef]
  40. J. Schäfer and K. Strimmer, "A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics," Statistical applications in genetics and molecular biology,  4, 32.1-30 (2005). [CrossRef]
  41. S. M. Kay, Fundamentals of Statistical Signal Processing (Prentice Hall, New Jersey, 1993).
  42. N. Mukhopadhyay, Probability and Statistical Inference (Marcel Dekker, Inc. New York, 2000).
  43. N. Ravishanker and D. K. Dey, A First Course in Linear Model Theory (Chapman & Hall/CRC, 2002).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Supplementary Material

» Media 1: AVI (3678 KB)     
» Media 2: AVI (3678 KB)     
» Media 3: AVI (3678 KB)     

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited