OSA's Digital Library

Optics Express

Optics Express

  • Editor: C. Martijn de Sterke
  • Vol. 20, Iss. 10 — May. 7, 2012
  • pp: 10971–10983

High-resolution lightfield photography using two masks

Zhimin Xu, Jun Ke, and Edmund Y. Lam  »View Author Affiliations

Optics Express, Vol. 20, Issue 10, pp. 10971-10983 (2012)

View Full Text Article

Enhanced HTML    Acrobat PDF (1181 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



A major theme of computational photography is the acquisition of lightfield, which opens up new imaging capabilities, such as focusing after image capture. However, to capture the lightfield, one normally has to sacrifice significant spatial resolution as compared to normal imaging for a fixed sensor size. In this work, we present a new design for lightfield acquisition, which allows for the capture of a higher resolution lightfield by using two attenuation masks. They are positioned at the aperture stop and the optical path respectively, so that the four-dimensional (4D) lightfield spectrum is encoded and sampled by a two-dimensional (2D) camera sensor in a single snapshot. Then, during post-processing, by exploiting the coherence embedded in a lightfield, we can retrieve the desired 4D lightfield with a higher resolution using inverse imaging. The performance of our proposed method is demonstrated with simulations based on actual lightfield datasets.

© 2012 OSA

OCIS Codes
(100.3020) Image processing : Image reconstruction-restoration
(100.3190) Image processing : Inverse problems
(110.1758) Imaging systems : Computational imaging
(110.3010) Imaging systems : Image reconstruction techniques

ToC Category:
Imaging Systems

Original Manuscript: March 8, 2012
Revised Manuscript: April 21, 2012
Manuscript Accepted: April 22, 2012
Published: April 26, 2012

Zhimin Xu, Jun Ke, and Edmund Y. Lam, "High-resolution lightfield photography using two masks," Opt. Express 20, 10971-10983 (2012)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. E. Y. Lam, “Computational photography: Advances and challenges,” in Tribute to Joseph W. Goodman, H. J. Caulfield and H. H. Arsenault, eds., Proc. SPIE 8122, 81220O (2011).
  2. W. T. Cathey and E. R. Dowski, “New paradigm for imaging systems,” Appl. Opt.41, 6080–6092 (2002). [CrossRef] [PubMed]
  3. J. Mait, R. Athale, and J. van der Gracht, “Evolutionary paths in imaging and recent trends,” Opt. Express11, 2093–2101 (2003). [CrossRef] [PubMed]
  4. W.-S. Chan, E. Y. Lam, M. K. Ng, and G. Y. Mak, “Super-resolution reconstruction in a computational compound-eye imaging system,” Multidim. Syst. Sign. Process18, 83–101 (2007). [CrossRef]
  5. T. Mirani, D. Rajan, M. P. Christensen, S. C. Douglas, and S. L. Wood, “Computational imaging systems: Joint design and end-to-end optimality,” Appl. Opt.47, B86–B103 (2008). [CrossRef] [PubMed]
  6. M. Levoy and P. Hanrahan, “Light field rendering,” in Proceedings of ACM SIGGRAPH (1996), pp. 31–42.
  7. J. W. Goodman, Introduction to Fourier Optics, 3rd ed. (Roberts and Company Publishers, 2004).
  8. E. H. Adelson and J. R. Bergen, “The plenoptic function and the elements of early vision,” in Computational Models of Visual Processing, M. S. Landy and J. A. Movshon, eds. (MIT Press, 1991), pp. 3–20.
  9. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Proceedings of ACM SIGGRAPH (1996), pp. 43–54.
  10. G. Lippmann, “Épreuves réversibles donnant la sensation du relief,” J. Phys. Théor. Appl.7, 821–825 (1908). [CrossRef] [PubMed]
  11. B. Wilburn, N. Joshi, V. Vaish, E.-V. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, “High performance imaging using large camera arrays,” in Proceedings of ACM SIGGRAPH (2005), pp. 765–776. [CrossRef]
  12. E. H. Adelson and J. Y. Wang, “Single lens stereo with a plenoptic camera,” IEEE Trans. Pattern Anal. Mach. Intell.14, 99–106 (1992). [CrossRef]
  13. R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, and P. Hanrahan, “Light field photography with a hand-held plenoptic camera,” Stanford Tech. Report CTSR (2005), pp. 1–11.
  14. A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, “Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing,” in Proceedings of ACM SIGGRAPH26, (2007).
  15. A. Agrawal, A. Veeraraghavan, and R. Raskar, “Reinterpretable imager: Towards variable post-capture space, angle and time resolution in photography,” Comput. Graph. Forum29, 763–772 (2010). [CrossRef]
  16. T. Georgeiv, K. C. Zheng, B. Curless, D. Salesin, S. Nayar, and C. Intwala, “Spatio-angular resolution tradeoff in integral photography,” in Proceedings of Eurographics Symposium on Rendering (2006), pp. 263–272.
  17. Z. Xu and E. Y. Lam, “Light field superresolution reconstruction in computational photography,” in Signal Recovery and Synthesis, (Optical Society of America, 2011), p. SMB3.
  18. C.-K. Liang, T.-H. Lin, B.-Y. Wong, C. Liu, and H. H. Chen, “Programmable aperture photography: multiplexed light field acquisition,” in Proceedings of ACM SIGGRAPH27 (2008), pp. 1–10. [CrossRef]
  19. A. Lumsdaine and T. Georgiev, “The focused plenoptic camera,” in Proceedings of IEEE International Conference on Computational Photography (IEEE, 2009), pp. 1–8. [CrossRef]
  20. R. N. Bracewell, The Fourier Transform and Its Applications, 3rd ed. (McGraw-Hill, 1999).
  21. J.-X. Chai, X. Tong, S.-C. Chan, and H.-Y. Shum, “Plenoptic sampling,” in Proceedings of ACM SIGGRAPH27 (2000), pp. 307–318.
  22. A. Levin, W. T. Freeman, and F. Durand, “Understanding camera trade-offs through a Bayesian analysis of light field projections,” in Proceedings of the 10th European Conference on Computer Vision (2008), pp. 88–101.
  23. Z. Xu and E. Y. Lam, “A spatial projection analysis of light field capture,” in Frontiers in Optics, (Optical Society of America, 2010), p. FWH2.
  24. W. U. Bajwa, J. D. Haupt, G. M. Raz, S. J. Wright, and R. D. Nowak, “Toeplitz-structured compressed sensing matrices,” in Proceedings of IEEE/SP 14th Workshop on Statistical Signal Processing, (IEEE, 2007), pp. 294–298. [CrossRef]
  25. W. Yin, S. Morgan, J. Yang, and Y. Zhang, “Practical compressive sensing with Toeplitz and circulant matrices,” in Visual Communications and Image Processing, Proc. SPIE 7744, 77440K (2010).
  26. L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D60, 259–268 (1992). [CrossRef]
  27. E. Y. Lam, X. Zhang, H. Vo, T.-C. Poon, and G. Indebetouw, “Three-dimensional microscopy and sectional image reconstruction using optical scanning holography,” Appl. Opt.48, H113–H119 (2009). [CrossRef] [PubMed]
  28. X. Zhang and E. Y. Lam, “Edge-preserving sectional image reconstruction in optical scanning holography,” J. Opt. Soc. Am. A27, 1630–1637 (2010). [CrossRef]
  29. Z. Xu and E. Y. Lam, “Image reconstruction using spectroscopic and hyperspectral information for compressive terahertz imaging,” J. Opt. Soc. Am. A27, 1638–1646 (2010). [CrossRef]
  30. “The (new) Stanford light field archive,” http://lightfield.stanford.edu/lfs.html .

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited