OSA's Digital Library

Applied Optics

Applied Optics


  • Editor: Joseph N. Mait
  • Vol. 48, Iss. 28 — Oct. 1, 2009
  • pp: 5386–5395

Structure of light fields in natural scenes

Alexander A. Mury, Sylvia C. Pont, and Jan J. Koenderink  »View Author Affiliations

Applied Optics, Vol. 48, Issue 28, pp. 5386-5395 (2009)

View Full Text Article

Enhanced HTML    Acrobat PDF (837 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



Light fields [ J. Math. Phys. 18, 51 (1936);The Photic Field (MIT, 1981)] of natural scenes are highly complex and vary within a scene from point to point. However, in many applications complex lighting can be successfully replaced by its low-order approximation [ J. Opt. Soc. Am. A 18, 2448 (2001); Appl. Opt. 46, 7308 (2007)]. The purpose of this research is to investigate the structure of light fields in natural scenes. We describe the structure of light fields in terms of spherical harmonics and analyze their spatial variation and qualitative properties over scenes. We consider several types of natural scene geometries. Empirically and via modeling, we study the typical behavior of the first- and second-order approximation of the local light field in those scenes. The first-order term is generally known as the “light vector” and has an immediate physical meaning. The quadrupole component, which we named “squash tensor,” is a useful addition as we show in this paper. The measurements were done with a custom-made device of novel design, called a “Plenopter,” which was constructed to measure the light field in terms of spherical harmonics up to the second order. In different scenes of similar geometries, we found structurally similar light fields, which suggests that in some way the light field can be thought of as a property of the geometry. Furthermore, the smooth variation of the light field’s low-order components suggests that, instead of specifying the complete light field of the scene, it is often sufficient to measure the light field only in a few points and rely on interpolation to recover the light field at arbitrary points of the scene.

© 2009 Optical Society of America

OCIS Codes
(120.5240) Instrumentation, measurement, and metrology : Photometry
(150.2950) Machine vision : Illumination

ToC Category:
Instrumentation, Measurement, and Metrology

Original Manuscript: November 21, 2008
Revised Manuscript: August 17, 2009
Manuscript Accepted: August 23, 2009
Published: September 25, 2009

Alexander A. Mury, Sylvia C. Pont, and Jan J. Koenderink, "Structure of light fields in natural scenes," Appl. Opt. 48, 5386-5395 (2009)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. C. Cuttle, Lighting by Design (Architectural Press, 2003).
  2. C. Cuttle, “Lighting patterns and the flow of light,” Light. Res. Technol. 3, 171-189 (1971).
  3. L. Michel, Light: the Shape of Space (Wiley, 1995).
  4. T. S. Jacobs, Drawing with an Open Mind (Watson-Guptill, 1991).
  5. M. Baxandall, Shadows and Enlightenment (Yale University, 1995).
  6. A. Adams, The Negative (Little, Brown and Company, 1981).
  7. R. O. Dror, T. K. Leung, E. H. Adelson, and A. S. Willsky, “Statistics of real-world illumination,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (IEEE, 2001), pp. 164-171.
  8. R. W. Fleming, R. O. Dror, and E. H. Adelson, “Real-world illumination and the perception of surface reflectance properties,” J. Vision 3, 347-368 (2003). [CrossRef]
  9. R. O. Dror, A. S. Willsky, and E. H. Adelson, “Statistical characterization of real-world illumination,” J. Vision 4, 821-837(2004). [CrossRef]
  10. J. Huang and D. Mumford, “Statistics of natural images and models,” in Computer Vision and Pattern Recognition (IEEE, 1999), pp. 541-547.
  11. S. Teller, M. Antone, M. Bosse, S. Coorg, M. Jethwa, and N. Master, “Calibrated, registered images of an extended urban area,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2001), pp. 93-107.
  12. A. A. Mury, S. C. Pont, and J. J. Koenderink, “Light field constancy within natural scenes,” Appl. Opt. 46, 7308-7316(2007). [CrossRef] [PubMed]
  13. A. Gershun, “The light field,” J. Math. Phys. 18, 51-151 (1936) (translated by P. Moon and G. Timoshenko).
  14. E. H. Adelson and J. R. Bergen, “The plenoptic function and the elements of early vision,” in Computational Models of Visual Processing, M. Landy and J. A. Movshon, eds. (MIT, 1991), pp. 3-20.
  15. R. Ramamoorthi and P. Hanrahan, “On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object,” J. Opt. Soc. Am. A 18, 2448-2459 (2001). [CrossRef]
  16. J. D. Foley, A. van Dam, S. K. Feiner, and J. F. Hughes, Computer Graphics, Principles and Practice (Addison Wesley, 1990).
  17. C. J. Copi, D. Huterer, D. J. Schwarz, and G. D. Starkman, “On the large-angle anomalies of the microwave sky,” Mon. Not. R. Astron. Soc. 1-27 (2005).
  18. M. R. Dennis and K. Land, “Probability density of the multipole vectors for a Gaussian cosmic microwave background,” Mon. Not. R. Astron. Soc. 383(2), 424-434 (2007). [CrossRef]
  19. J. J. Koenderink and A. J. van Doorn, “Geometrical modes as a general method to treat diffuse interreflections in radiometry,” J. Opt. Soc. Am. 73, 843-850 (1983). [CrossRef]
  20. P. Moon and D. E. Spencer, The Photic Field (MIT, 1981).
  21. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C (Cambridge University, 1988).
  22. S. Darula and R. Kittler, “CIE General Sky standard defining luminance distributions,” in Proceedings ESim Conference (IBPSA, 2002), pp. 1113.
  23. H. Akbari, L. S. Rose, and H. Taha, “Characterizing the fabric of the urban environment: a case study of Sacramento, California,” LBNL-44688, Lawrence Berkeley National Laboratory, Berkeley, California, 1999.
  24. S. C. Pont and J. J. Koenderink, “Reflectance from locally glossy thoroughly pitted surfaces,” Comput. Vision Image Understand. 98 (2), 211-222 (2005). [CrossRef]
  25. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, “The lumigraph,” in Computer Graphics (SIGGRAPH96) Proceedings (ACM, 1996), pp. 43-54.
  26. H. M. Fox and G. Vevers, The Nature of Animal Colours (Sidqwick and Jackson, 1960).
  27. D. Gomez and M. Thery, “Simultaneous crypsis and conspicuousness in color patterns: comparative analysis of a neotropical rainforest bird community,” Am. Nat. 169, S42-S61 (2007). [CrossRef]
  28. G. H. Thayer, Concealing Coloration in the Animal Kingdom (Macmillan, 1909/1918).
  29. J. A. Endler, “The color of light in forests and its implications,” in Ecological Monographs 63 (Ecological Society of America, 1993), pp. 1-27. [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited