OSA's Digital Library

Optics Express

Optics Express

  • Editor: Andrew M. Weiner
  • Vol. 22, Iss. 9 — May. 5, 2014
  • pp: 10210–10220

Real-time integral imaging system for light field microscopy

Jonghyun Kim, Jae-Hyun Jung, Youngmo Jeong, Keehoon Hong, and Byoungho Lee  »View Author Affiliations

Optics Express, Vol. 22, Issue 9, pp. 10210-10220 (2014)

View Full Text Article

Enhanced HTML    Acrobat PDF (2497 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



We propose a real-time integral imaging system for light field microscopy systems. To implement a 3D live in-vivo experimental environment for multiple experimentalists, we generate elemental images for an integral imaging system from the captured light field with a light field microscope in real-time. We apply the f-number matching method to generate an elemental image to reconstruct an undistorted 3D image. Our implemented system produces real and orthoscopic 3D images of micro objects in 16 frames per second. We verify the proposed system via experiments using Caenorhabditis elegans.

© 2014 Optical Society of America

OCIS Codes
(100.6890) Image processing : Three-dimensional image processing
(110.2990) Imaging systems : Image formation theory
(180.6900) Microscopy : Three-dimensional microscopy

ToC Category:

Original Manuscript: February 21, 2014
Revised Manuscript: April 14, 2014
Manuscript Accepted: April 15, 2014
Published: April 21, 2014

Virtual Issues
Vol. 9, Iss. 7 Virtual Journal for Biomedical Optics

Jonghyun Kim, Jae-Hyun Jung, Youngmo Jeong, Keehoon Hong, and Byoungho Lee, "Real-time integral imaging system for light field microscopy," Opt. Express 22, 10210-10220 (2014)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. F. Okano, J. Arai, H. Hoshino, I. Yuyama, “Three-dimensional video system based on integral photography,” Opt. Eng. 38(6), 1072–1077 (1999). [CrossRef]
  2. B. Javidi, S. Yeom, I. Moon, M. Daneshpanah, “Real-time automated 3D sensing, detection, and recognition of dynamic biological micro-organic events,” Opt. Express 14(9), 3806–3829 (2006). [CrossRef] [PubMed]
  3. W. J. Matusik, H. Pfister, “3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes,” ACM Trans. Graph. 23(3), 814–824 (2004). [CrossRef]
  4. F. Okano, H. Hoshino, J. Arai, I. Yuyama, “Real-time pickup method for a three-dimensional image based on integral photography,” Appl. Opt. 36(7), 1598–1603 (1997). [CrossRef] [PubMed]
  5. G. Li, K.-C. Kwon, K.-H. Yoo, S.-G. Gil, and N. Kim, “Real-time display for real-existing three-dimensional objects with computer-generated integral imaging,” in Proceeding of International Meeting on Information Display (IMID), Daegu, Korea, Aug. 2012 (Society for Information Display and Korean Society for Information Display, 2012), pp. 471–472.
  6. J. Arai, F. Okano, H. Hoshino, I. Yuyama, “Gradient-index lens-array method based on real-time integral photography for three-dimensional images,” Appl. Opt. 37(11), 2034–2045 (1998). [CrossRef] [PubMed]
  7. J. Arai, T. Yamashita, M. Miura, H. Hiura, N. Okaichi, F. Okano, R. Funatsu, “Integral three-dimensional image capture equipment with closely positioned lens array and image sensor,” Opt. Lett. 38(12), 2044–2046 (2013). [CrossRef] [PubMed]
  8. M. Martínez-Corral, B. Javidi, R. Martínez-Cuenca, G. Saavedra, “Formation of real, orthoscopic integral images by smart pixel mapping,” Opt. Express 13(23), 9175–9180 (2005). [CrossRef] [PubMed]
  9. J.-H. Jung, J. Kim, B. Lee, “Solution of pseudoscopic problem in integral imaging for real-time processing,” Opt. Lett. 38(1), 76–78 (2013). [CrossRef] [PubMed]
  10. J. Kim, J.-H. Jung, B. Lee, “Real-time pickup and display integral imaging system without pseudoscopic problem,” Proc. SPIE 8643, 864303 (2013). [CrossRef]
  11. J. Kim, J.-H. Jung, C. Jang, B. Lee, “Real-time capturing and 3D visualization method based on integral imaging,” Opt. Express 21(16), 18742–18753 (2013). [CrossRef] [PubMed]
  12. B. Lee, “Three-dimensional displays, past and present,” Phys. Today 66(4), 36–41 (2013). [CrossRef]
  13. J.-H. Park, K. Hong, B. Lee, “Recent progress in three-dimensional information processing based on integral imaging,” Appl. Opt. 48(34), H77–H94 (2009). [CrossRef] [PubMed]
  14. J. Hong, Y. Kim, H.-J. Choi, J. Hahn, J.-H. Park, H. Kim, S.-W. Min, N. Chen, B. Lee, “Three-dimensional display technologies of recent interest: principles, status, and issues [Invited],” Appl. Opt. 50(34), H87–H115 (2011). [CrossRef] [PubMed]
  15. M. Kawakita, K. Iizuka, H. Nakamura, I. Mizuno, T. Kurita, T. Aida, Y. Yamanouchi, H. Mitsumine, T. Fukaya, H. Kikuchi, F. Sato, “High-definition real-time depth-mapping TV camera: HDTV axi-vision camera,” Opt. Express 12(12), 2781–2794 (2004). [CrossRef] [PubMed]
  16. E.-H. Kim, J. Hahn, H. Kim, B. Lee, “Profilometry without phase unwrapping using multi-frequency and four-step phase-shift sinusoidal fringe projection,” Opt. Express 17(10), 7818–7830 (2009). [CrossRef] [PubMed]
  17. J.-H. Jung, K. Hong, G. Park, I. Chung, J.-H. Park, B. Lee, “Reconstruction of three-dimensional occluded object using optical flow and triangular mesh reconstruction in integral imaging,” Opt. Express 18(25), 26373–26387 (2010). [CrossRef] [PubMed]
  18. J.-H. Jung, J. Yeom, J. Hong, K. Hong, S. W. Min, B. Lee, “Effect of fundamental depth resolution and cardboard effect to perceived depth resolution on multi-view display,” Opt. Express 19(21), 20468–20482 (2011). [CrossRef] [PubMed]
  19. G. Lippmann, “La photographie integrale,” C. R. Acad. Sci. 146, 446–451 (1908).
  20. P. Török and F. J. Kao, eds., Optical Imaging and Microscopy: Techniques and Advanced Systems (Springer, 2003).
  21. E. Betzig, R. J. Chichester, “Single molecules observed by near-field scanning optical microscopy,” Science 262(5138), 1422–1425 (1993). [CrossRef] [PubMed]
  22. M. Levoy, R. Ng, A. Adams, M. Footer, M. Horowitz, “Light field microscopy,” ACM Trans. Graph. 25(3), 924–934 (2006). [CrossRef]
  23. M. Levoy, Z. Zhang, I. McDowall, “Recording and controlling the 4D light field in a microscope using microlens arrays,” J. Microsc. 235(2), 144–162 (2009). [CrossRef] [PubMed]
  24. M. Broxton, L. Grosenick, S. Yang, N. Cohen, A. Andalman, K. Deisseroth, M. Levoy, “Wave optics theory and 3-D deconvolution for the light field microscope,” Opt. Express 21(21), 25418–25439 (2013). [CrossRef] [PubMed]
  25. Y. T. Lim, J. H. Park, K. C. Kwon, N. Kim, “Resolution-enhanced integral imaging microscopy that uses lens array shifting,” Opt. Express 17(21), 19253–19263 (2009). [CrossRef] [PubMed]
  26. A. Orth, K. Crozier, “Microscopy with microlens arrays: high throughput, high resolution and light-field imaging,” Opt. Express 20(12), 13522–13531 (2012). [CrossRef] [PubMed]
  27. J.-H. Park, S.-W. Min, S. Jung, B. Lee, “Analysis of viewing parameters for two display methods based on integral photography,” Appl. Opt. 40(29), 5217–5232 (2001). [CrossRef] [PubMed]
  28. Y.-T. Lim, J.-H. Park, K.-C. Kwon, N. Kim, “Analysis on enhanced depth of field for integral imaging microscope,” Opt. Express 20(21), 23480–23488 (2012). [CrossRef] [PubMed]
  29. B. Lee, J. Kim, “Real-time 3D capturing-visualization conversion for light field microscopy,” Proc. SPIE 8769, 876908 (2013). [CrossRef]
  30. A. Fire, S. Xu, M. K. Montgomery, S. A. Kostas, S. E. Driver, C. C. Mello, “Potent and specific genetic interference by double-stranded RNA in Caenorhabditis elegans,” Nature 391(6669), 806–811 (1998). [CrossRef] [PubMed]
  31. H. Lee, M. K. Choi, D. Lee, H. S. Kim, H. Hwang, H. Kim, S. Park, Y. K. Paik, J. Lee, “Nictation, a dispersal behavior of the nematode Caenorhabditis elegans, is regulated by IL2 neurons,” Nat. Neurosci. 15(1), 107–112 (2011). [CrossRef] [PubMed]
  32. J.-H. Park, H. Choi, Y. Kim, J. Kim, B. Lee, “Scaling of three-dimensional integral imaging,” Jpn. J. Appl. Phys. 44(1A), 216–224 (2005). [CrossRef]
  33. R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz, and P. Hanrahan, “Light field photography with a hand-held plenoptic camera,” Stanford Tech. Rep. CTSR 2005–02 (Stanford University, 2005).
  34. C. Jang, J. Kim, J. Yeom, and B. Lee, “Analysis of color separation reduction through the gap control method in integral imaging,” J. Inf. Disp. 15(2) (to be published).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Supplementary Material

» Media 1: MOV (2475 KB)     
» Media 2: MOV (8392 KB)     
» Media 3: MOV (5768 KB)     

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited