OSA's Digital Library

Optics Express

Optics Express

  • Editor: C. Martijn de Sterke
  • Vol. 16, Iss. 21 — Oct. 13, 2008
  • pp: 16294–16304

Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging

Dong-Hak Shin, Byung-Gook Lee, and Joon-Jae Lee  »View Author Affiliations


Optics Express, Vol. 16, Issue 21, pp. 16294-16304 (2008)
http://dx.doi.org/10.1364/OE.16.016294


View Full Text Article

Enhanced HTML    Acrobat PDF (839 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

In this paper, we propose an occlusion removal method using sub-image block matching for improved recognition of partially occluded 3D objects in computational integral imaging (CII). When 3D plane images are reconstructed in CII, occlusion degrades the resolution of reconstructed images. To overcome this problem, we apply the sub-image transform to elemental image array (EIA) and these sub-images are employed using block matching method for depth estimation. Based on the estimated depth information, we remove the unknown occlusion. After completing the occlusion removal for all sub-images, we obtain the modified EIA without occlusion information through the inverse sub-image transform. Finally, the 3D plane images are reconstructed by using a computational integral imaging reconstruction method with the modified EIA. The proposed method can provide a substantial gain in terms of the visual quality of 3D reconstructed images. To show the usefulness of the proposed method we carry out some experiments and the results are presented.

© 2008 Optical Society of America

OCIS Codes
(100.6890) Image processing : Three-dimensional image processing
(110.2990) Imaging systems : Image formation theory
(110.6880) Imaging systems : Three-dimensional image acquisition

ToC Category:
Image Processing

History
Original Manuscript: May 7, 2008
Revised Manuscript: June 30, 2008
Manuscript Accepted: July 24, 2008
Published: September 29, 2008

Citation
Dong-Hak Shin, Byung-Gook Lee, and Joon-Jae Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Opt. Express 16, 16294-16304 (2008)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-16-21-16294


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. G. Lippmann, "La photographic integrale," C.R. Acad. Sci. 146, 446-451 (1908).
  2. A. Stern and B. Javidi, "Three dimensional image sensing, visualization, and processing using integral imaging," Proc. of IEEE 94, 591-607 (2006). [CrossRef]
  3. B. Lee, S.-Y. Jung, S.-W. Min, and J.-H. Park, "Three-dimensional display by use of integral photography with dynamically variable image planes," Opt. Lett. 26, 1481-1482 (2001). [CrossRef]
  4. J.-S. Jang and B. Javidi, "Improved viewing resolution of three- dimensional integral imaging by use of nonstationary micro-optics," Opt. Lett. 27, 324-326 (2002). [CrossRef]
  5. M. Martínez-Corral, B. Javidi, R. Martínez-Cuenca, and G. Saavedra, "Multifacet structure of observed reconstructed integral images," J. Opt. Soc. Am. A 22, 597-603 (2005). [CrossRef]
  6. D.-H. Shin, B. Lee, and E.-S. Kim, "Multidirectional curved integral imaging with large depth by additional use of a large-aperture lens," Appl. Opt. 45, 7375-7381 (2006). [CrossRef] [PubMed]
  7. D.-H. Shin, S.-H. Lee, and E.-S. Kim, "Optical display of ture 3D objects in depth-priority integral imaging using an active sensor," Opt. Commun. 275, 330-334 (2007). [CrossRef]
  8. H. Arimoto and B. Javidi, "Integral three-dimensional imaging with digital reconstruction," Opt. Lett. 26, 157-159 (2001). [CrossRef]
  9. Y. Frauel and B. Javidi, "Digital three-dimensional image correlation by use of computer-reconstructed integral imaging," Appl. Opt. 41, 5488-5496 (2002). [CrossRef] [PubMed]
  10. S.-H. Hong, J.-S. Jang, and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004). [CrossRef] [PubMed]
  11. D.-H. Shin, E.-S. Kim, and B. Lee, "Computational reconstruction technique of three-dimensional object in integral imaging using a lenslet array," Jpn. J. Appl. Phys. 44, 8016-8018 (2005). [CrossRef]
  12. S.-H. Hong and B. Javidi, "Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing," Opt. Express 12, 4579-4588 (2004). [CrossRef] [PubMed]
  13. S.-H. Hong and B. Javidi, "Distortion-tolerant 3D recognition of occluded objects using computational integral imaging," Opt. Express 14, 12085-12095 (2006). [CrossRef] [PubMed]
  14. D.-H. Shin and H. Yoo, "Image quality enhancement in 3D computational integral imaging by use of interpolation methods," Opt. Express 15, 12039-12049 (2007). [CrossRef] [PubMed]
  15. H. Yoo and D.-H. Shin "Improved analysis on the signal property of computational integral imaging system," Opt. Express 15, 14107-14114 (2007). [CrossRef] [PubMed]
  16. B. Javidi, R. Ponce-Díaz, and S.-H. Hong, "Three-dimensional recognition of occluded objects by using computational integral imaging," Opt. Lett. 31, 1106-1108 (2006). [CrossRef] [PubMed]
  17. J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, "Resolution-enhanced 3D image correlator using computationally reconstructed integral images," Opt. Commun. 276, 72-79 (2007). [CrossRef]
  18. J.-H. Park, J. Kim, and B. Lee, "Three-dimensional optical correlator using a sub-image array," Opt. Express 13, 5116-5126 (2005). [CrossRef] [PubMed]
  19. D.-H. Shin, B. Lee, and E.-S. Kim, "Improved viewing quality of 3-D images in computational integral imaging reconstruction based on lenslet array model," ETRI J. 28, 521-524 (2006). [CrossRef]
  20. M. Z. Brown, D. Burschka, and S. D. Hager, "Advances in computational stereo," IEEE Trans. Pattern Analysis and Machine Intelligence 25, 993-1008 (2003). [CrossRef]
  21. J.-S. Lee, J.-H. Ko, and E.-S. Kim, "Real-time stereo object tracking system by using block matching algorithm and optical binary phase extraction joint transform correlator," Opt. Commun. 191, 191-202 (2001). [CrossRef]
  22. S.-H. Hong and B. Javidi, "Three-dimensional visualization of partially occluded objects using integral imaging," J. Display Technol. 1, 354-359 (2005). [CrossRef]
  23. J. -S. Jang and B. Javidi, "Depth and lateral size control of three-dimensional images in projection integral imaging," Opt. Express 12, 3778-3790 (2004). [CrossRef] [PubMed]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited