OSA's Digital Library

Journal of Display Technology

Journal of Display Technology


  • Vol. 8, Iss. 8 — Aug. 1, 2012
  • pp: 483–490

Occlusion Removal Using Depth Mapping in Three-Dimensional Integral Imaging

Xiao Xiao, Mehdi Daneshpanah, and Bahram Javidi

Journal of Display Technology, Vol. 8, Issue 8, pp. 483-490 (2012)

View Full Text Article

Acrobat PDF (1270 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

  • Export Citation/Save Click for help


In this paper, we present an occlusion removal method to enhance reconstructed images of occluded three-dimensional (3D) objects based on pixel depth mapping technique in 3D multi-perspective imaging. Depth mapping is achieved by minimizing the statistical variance of projection image pixels of 3D object points on different perspective images. Then depth map and variance map are utilized to classify elemental image pixels into object or occlusion classes. Based on pixel classification results, a modified reconstruction algorithm is used to reconstruct the object without the effect of occlusion. In the proposed method, the occlusion is unknown and may be arbitrarily placed in front of the scene. Experimental results are presented to evaluate the effectiveness of the proposed method.

© 2012 IEEE

Xiao Xiao, Mehdi Daneshpanah, and Bahram Javidi, "Occlusion Removal Using Depth Mapping in Three-Dimensional Integral Imaging," J. Display Technol. 8, 483-490 (2012)

Sort:  Year  |  Journal  |  Reset


  1. G. Lippmann, "Epreuves reversibles donnant la sensation du relief," J. Phys. 7, 821-825 (1908).
  2. H. E. Ives, "Optical properties of a Lippman lenticulated sheet," JOSA 21, 171 (1931).
  3. C. B. Burckhardt, "Optimum parameters and resolution limitation of integral photography," J. Opt. Soc. Amer. 58, 71-74 (1968).
  4. Y. Igarishi, H. Murata, M. Ueda, "3D display system using a computer-generated integral photograph," Jpn. J. Appl. Phys. 17, 1683-1684 (1978).
  5. T. Okoshi, "Three-dimensional displays," Proc. IEEE 68, 548-564 (1980).
  6. H. Hoshino, F. Okano, H. Isono, I. Yuyama, "Analysis of resolution limitation of integral photography," J. OSA Opt., Image Sci. Vision 15, 2059-2065 (1998).
  7. H. Arimoto, B. Javidi, "Integral three-dimensional imaging with digital reconstruction," Opt. Lett. 26, 157-159 (2001).
  8. M. C. Forman, N. Davies, M. McCormick, "Continuous parallax in discrete pixilated integral three-dimensional displays," J. OSA Opt., Image Sci. Vision 20, 411-420 (2003).
  9. S. H. Hong, J. S. Jang, B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).
  10. H. Liao, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, T. Dohi, "Surgical navigation by autostereoscopic image overlay of integral videography," IEEE Trans. Inf. Technol. Biomed. 8, 114-121 (2004).
  11. M. Martinez-Corral, B. Javidi, R. Martinez-Cuenca, G. Saavedra, "Formation of real, orthoscopic integral images by smart pixel mapping," Opt. Express 13, 9175-9180 (2005).
  12. F. Okano, J. Arai, K. Mitani, M. Okui, "Real-time integral imaging based on extremely high resolution video system," Proc. IEEE 94, 490-501 (2006).
  13. A. Stern, B. Javidi, "3D image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-608 (2006).
  14. B. Javidi, F. Okano, J. Y. Son, Three-Dimensional Imag., Vis., Display (Springer, 2009).
  15. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009).
  16. M. DaneshPanah, B. Javidi, E. A. Watson, "Three dimensional imaging with randomly distributed sensors," Opt. Express 16, 6368-6377 (2008).
  17. M. Pollefeys, R. Koch, M. Vergauwen, B. Deknuydt, L. Van Gool, "Three-dimensional scene reconstruction from images," Three-Dimensional Image Capture and Appl. III 215-226 (2000).
  18. L. Guan, J. Franco, E. Boyer, M. Pollefeys, "Probabilistic 3D occupancy flow with latent silhouette cues," 2010 IEEE Conf. on Comput. Vision and Pattern Recogn. (CVPR) (2010) pp. 1379-1386.
  19. J. S. Jang, B. Javidi, "Three-dimensional synthetic aperture integral imaging," Opt. Lett. 27, 1144-1146 (2002).
  20. S. H. Hong, B. Javidi, "Three-dimensional visualization of partially occluded objects using integral imaging," J. Display Technol. 1, 354-359 (2005).
  21. M. Cho, B. Javidi, "Three-dimensional visualization of objects in turbid water using integral imaging," J. Display Technol. 6, 544-547 (2010).
  22. I. Moon, B. Javidi, "Three-dimensional visualization of objects in scattering medium by use of computational integral imaging," Opt. Express 16, 13080-13089 (2008).
  23. B. Javidi, R. Ponce-Diaz, S. H. Hong, "Three-dimensional recognition of occluded objects by using computational integral imaging," Opt. Lett. 31, 1106-1108 (2006).
  24. R. Schulein, C. M. Do, B. Javidi, "Distortion-tolerant 3D recognition of underwater objects using neural networks," J. Opt. Soc. Amer. A Opt. Image Sci. Vis. 27, 461-468 (2010).
  25. D. H. Shin, B. G. Lee, J. J. Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Opt. Express 16, 16294-16304 (2008).
  26. J. J. Lee, B. G. Lee, H. Yoo, "Image quality enhancement of computational integral imaging reconstruction for partially occluded objects using binary weighting mask on occlusion areas," Appl. Opt. 50, 1889-1893 (2011).
  27. M. DaneshPanah, B. Javidi, "Profilometry and optical slicing by passive three-dimensional imaging," Opt. Lett. 34, 1105-1107 (2009).
  28. R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision (Cambridge Univ. Press, 2000).

Cited By

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article

OSA is a member of CrossRef.

CrossCheck Deposited