OSA's Digital Library

Optics Express

Optics Express

  • Editor: Andrew M. Weiner
  • Vol. 21, Iss. 21 — Oct. 21, 2013
  • pp: 25418–25439

Wave optics theory and 3-D deconvolution for the light field microscope

Michael Broxton, Logan Grosenick, Samuel Yang, Noy Cohen, Aaron Andalman, Karl Deisseroth, and Marc Levoy  »View Author Affiliations


Optics Express, Vol. 21, Issue 21, pp. 25418-25439 (2013)
http://dx.doi.org/10.1364/OE.21.025418


View Full Text Article

Enhanced HTML    Acrobat PDF (8015 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Light field microscopy is a new technique for high-speed volumetric imaging of weakly scattering or fluorescent specimens. It employs an array of microlenses to trade off spatial resolution against angular resolution, thereby allowing a 4-D light field to be captured using a single photographic exposure without the need for scanning. The recorded light field can then be used to computationally reconstruct a full volume. In this paper, we present an optical model for light field microscopy based on wave optics, instead of previously reported ray optics models. We also present a 3-D deconvolution method for light field microscopy that is able to reconstruct volumes at higher spatial resolution, and with better optical sectioning, than previously reported. To accomplish this, we take advantage of the dense spatio-angular sampling provided by a microlens array at axial positions away from the native object plane. This dense sampling permits us to decode aliasing present in the light field to reconstruct high-frequency information. We formulate our method as an inverse problem for reconstructing the 3-D volume, which we solve using a GPU-accelerated iterative algorithm. Theoretical limits on the depth-dependent lateral resolution of the reconstructed volumes are derived. We show that these limits are in good agreement with experimental results on a standard USAF 1951 resolution target. Finally, we present 3-D reconstructions of pollen grains that demonstrate the improvements in fidelity made possible by our method.

© 2013 OSA

OCIS Codes
(100.1830) Image processing : Deconvolution
(100.3190) Image processing : Inverse problems
(100.6950) Image processing : Tomographic image processing
(180.2520) Microscopy : Fluorescence microscopy
(180.6900) Microscopy : Three-dimensional microscopy

ToC Category:
Image Processing

History
Original Manuscript: July 16, 2013
Revised Manuscript: September 30, 2013
Manuscript Accepted: October 4, 2013
Published: October 17, 2013

Citation
Michael Broxton, Logan Grosenick, Samuel Yang, Noy Cohen, Aaron Andalman, Karl Deisseroth, and Marc Levoy, "Wave optics theory and 3-D deconvolution for the light field microscope," Opt. Express 21, 25418-25439 (2013)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-21-21-25418


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, “Light field microscopy,” in Proceedings of ACM SIGGRAPH. (2006) 924–934. [CrossRef]
  2. M. Levoy, Z. Zhang, and I. McDowell, “Recording and controlling the 4D light field in a microscope using microlens arrays,” Journal of Microscopy235, 144–162 (2009). [CrossRef] [PubMed]
  3. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, “Advances and challenges in super-resolution,” International Journal of Imaging Systems and Technology14, 47–57 (2004). [CrossRef]
  4. R. Ng, “Fourier slice photography,” in Proceedings of ACM SIGGRAPH(2005). 735–744. [CrossRef]
  5. M. Bertero and C. de Mol, “III Super-resolution by data inversion,” in Progress in Optics (Elsevier, 1996) pp. 129–178. [CrossRef]
  6. T. Pham, L. van Vliet, and K. Schutte, “Influence of signal-to-noise ratio and point spread function on limits of superresolution,” Proc. SPIE5672, 169–180 (2005). [CrossRef]
  7. S. Baker and T. Kanade, “Limits on super-resolution and how to break them,” IEEE Trans. Pattern Anal. Mach. Intell.24. 1167–1183 (2002) [CrossRef]
  8. K. Grochenig and T. Strohmer, “Numerical and theoretical aspects of nonuniform sampling of band-limited images,” in “Nonuniform Sampling,” F. Marvasti, ed.. Information Technology: Transmission, Processing, and Storage, 283–324 (SpringerUS, 2010).
  9. T. Bishop and P. Favaro, “The light field camera: extended depth of field, aliasing and super-resolution,” IEEE Trans. Pattern Anal. Mach. Intell.34. 972–986 (2012). [CrossRef]
  10. W. Chan, E. Lam, M. Ng, and G. Mak, “Super-resolution reconstruction in a computational compound-eye imaging system,” Multidimensional Systems and Signal Processing18. 83–101. (2007). [CrossRef]
  11. M. Gu, Advanced Optical Imaging Theory (Springer, 1999).
  12. D. A. Agard, “Optical sectioning microscopy: cellular architecture in three dimensions,” Annual review of biophysics and bioengineering13, 191–219. (1984). [CrossRef] [PubMed]
  13. M. Born and E. Wolf, Principles of Optics, 7th ed. (Cambridge University, 1999).
  14. M. R. Arnison and C. J. R. Sheppard, “A 3D vectorial optical transfer function suitable for arbitrary pupil functions,” Optics communications211, 53–63 (2002). [CrossRef]
  15. A. Egner and S. W. Hell, “Equivalence of the Huygens–Fresnel and Debye approach for the calculation of high aperture point-spread functions in the presence of refractive index mismatch,” Journal of Microscopy193, 244–249 (1999). [CrossRef]
  16. J. Breckinridge, D. Voelz, and J. B. Breckinridge, Computational Fourier Optics: a MATLAB Tutorial (SPIE Press, 2011).
  17. J. M. Bardsley and J. G. Nagy, “Covariance-preconditioned iterative methods for nonnegatively constrained astronomical imaging,” SIAM journal on matrix analysis and applications27, 1184–1197 (2006). [CrossRef]
  18. M. Bertero, P. Boccacci, G. Desidera, and G. Vicidomini, “Image deblurring with Poisson data: from cells to galaxies,” Inverse Problems25, 123006 (2009). [CrossRef]
  19. S. Shroff and K. Berkner, “Image formation analysis and high resolution image reconstruction for plenoptic imaging systems,” Applied optics, 52, D22D31, (2013). [CrossRef]
  20. J. Rosen, N. Siegel, and G. Brooker, “Theoretical and experimental demonstration of resolution beyond the Rayleigh limit by FINCH fluorescence microscopic imaging,” Opt. Express19, 1506–1508 (2011). [CrossRef]
  21. I. J. Cox and C. J. R. Sheppard, “Information capacity and resolution in an optical system,” J. Opt. Soc. Am. A3, 1152 (1986). [CrossRef]
  22. R. Heintzmann, “Estimating missing information by maximum likelihood deconvolution,” Micron38, 136–144 (2007) [CrossRef]
  23. P. Favaro, “A split-sensor light field camera for extended depth of field and superresolution,” in “SPIE Conference Series,” 8436. (2012).
  24. C. H. Lu, S. Muenzel, and J. Fleischer, “High-resolution light-field microscopy,” in “Computational Optical Sensing and Imaging, Microscopy and Tomography I (CTh3B),” (2013).
  25. S. Abrahamsson, J. Chen, B. Hajj, S. Stallinga, A. Y. Katsov, J. Wisniewski, G. Mizuguchi, P. Soule, F. Mueller, C. D. Darzacq, X. Darzacq, C. Wu, C. I. Bargmann, D. A. Agard, M. G. L. Gustafsson, and M. Dahan, “Fast multicolor 3D imaging using aberration-corrected multifocus microscopy,” Nat. Meth.1–6. (2012).
  26. M. Pluta, Advanced Light Microscopy, Vol. 1.(Elsevier, 1988).
  27. J. Goodman, Introduction to Fourier Optics, 2nd ed. (MaGraw-Hill, 1996).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited