OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Editor: Stephen A. Burns
  • Vol. 25, Iss. 4 — Apr. 1, 2008
  • pp: 846–865

Image statistics for surface reflectance perception

Lavanya Sharan, Yuanzhen Li, Isamu Motoyoshi, Shin’ya Nishida, and Edward H. Adelson  »View Author Affiliations


JOSA A, Vol. 25, Issue 4, pp. 846-865 (2008)
http://dx.doi.org/10.1364/JOSAA.25.000846


View Full Text Article

Enhanced HTML    Acrobat PDF (2405 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Human observers can distinguish the albedo of real-world surfaces even when the surfaces are viewed in isolation, contrary to the Gelb effect. We sought to measure this ability and to understand the cues that might underlie it. We took photographs of complex surfaces such as stucco and asked observers to judge their diffuse reflectance by comparing them to a physical Munsell scale. Their judgments, while imperfect, were highly correlated with the true reflectance. The judgments were also highly correlated with certain image statistics, such as moment and percentile statistics of the luminance and subband histograms. When we digitally manipulated these statistics in an image, human judgments were correspondingly altered. Moreover, linear combinations of such statistics allow a machine vision system (operating within the constrained world of single surfaces) to estimate albedo with an accuracy similar to that of human observers. Taken together, these results indicate that some simple image statistics have a strong influence on the judgment of surface reflectance.

© 2008 Optical Society of America

OCIS Codes
(330.0330) Vision, color, and visual optics : Vision, color, and visual optics
(330.4060) Vision, color, and visual optics : Vision modeling
(330.5000) Vision, color, and visual optics : Vision - patterns and recognition
(330.5510) Vision, color, and visual optics : Psychophysics
(330.7310) Vision, color, and visual optics : Vision

ToC Category:
Vision, Color, and Visual Optics

History
Original Manuscript: August 3, 2007
Revised Manuscript: November 27, 2007
Manuscript Accepted: January 11, 2008
Published: March 13, 2008

Virtual Issues
Vol. 3, Iss. 5 Virtual Journal for Biomedical Optics

Citation
Lavanya Sharan, Yuanzhen Li, Isamu Motoyoshi, Shin'ya Nishida, and Edward H. Adelson, "Image statistics for surface reflectance perception," J. Opt. Soc. Am. A 25, 846-865 (2008)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-25-4-846


Sort:  Year  |  Journal  |  Reset  

References

  1. A.Gelb, “Die 'Farbenkonstanz' dez Sehdinge [Color constancy of visual objects],” in Handbuchder normalen und pathologischen Psychologie, W.A.von Bethe, ed. (Springer, 1929), pp. 594-678. [CrossRef]
  2. I. Motoyoshi, S. Nishida, L. Sharan, and E. H. Adelson, “Image statistics and the perception of surface qualities,” Nature 447, 206-209 (2007). [CrossRef] [PubMed]
  3. A. L. Gilchrist, “The perception of surface blacks and whites,” Sci. Am. 240, 112-124 (1979). [CrossRef] [PubMed]
  4. A. L. Gilchrist and A. Jacobsen, “Perception of lightness and illumination in a world of one reflectance,” Perception 13, 5-19 (1984). [CrossRef] [PubMed]
  5. E. H. Land and J. J. McCann, “Lightness and retinex theory,” J. Opt. Soc. Am. 61, 1-11 (1971). [CrossRef] [PubMed]
  6. A. L. Gilchrist, “Perceived lightness depends on perceived spatial arrangement,” Science 195, 185-187 (1977). [CrossRef] [PubMed]
  7. E. H. Adelson, “Perceptual organization and judgment of brightness,” Science 262, 2042-2044 (1993). [CrossRef] [PubMed]
  8. M. D'Zmura and G. Iverson, “Color constancy. I. Basic theory of two-stage linear recovery of spectral descriptions for lights and surfaces,” J. Opt. Soc. Am. A 10, 2148-2165 (1993). [CrossRef]
  9. D. H. Brainard, “Color constancy in the nearly natural image. 2. Achromatic loci,” J. Opt. Soc. Am. A 15, 307-325 (1998). [CrossRef]
  10. A. L. Gilchrist, C. Kossyfidis, F. Bonato, T. Agostini, J. Cataliotti, X. Li, B. Spehar, V. Annan, and E. Economou, “An anchoring theory of lightness perception,” Psychol. Rev. 106, 795-834 (1999). [CrossRef] [PubMed]
  11. M. G. Bloj, D. Kersten, and A. C. Hurlbert, “Perception of three-dimensional shape influences color perception through mutual illumination,” Nature 402, 877-879 (1999).
  12. H. Boyaci, L. T. Maloney, and S. Hersh, “The effect of perceived surface orientation on perceived surface albedo in binocularly viewed scenes,” J. Vision 3, 541-553 (2003). [CrossRef]
  13. D. H. Brainard, J. M. Kraft, and P. Longere, “Color constancy: developing empirical tests of computational models,” in Color Perception: From Light to Object, R.Mausfeld and D.Heyer, eds. (Oxford U. Press, 2003), pp. 307-334.
  14. L. T. Maloney and J. N. Yang, “The illumination estimation hypothesis and surface color perception,” in Color Vision: Connecting the Mind to the Physical World, R.Mausfeld and D.Heyer, eds. (Oxford U. Press, 2003), pp. 335-358.
  15. S. Nishida and M. Shinya, “Use of image-based information in judgments of surface reflectance properties,” J. Opt. Soc. Am. A 15, 2951-2965 (1998). [CrossRef]
  16. R. O. Dror, E. H. Adelson, and A. S. Willsky, “Recognition of surface reflectance properties from a single image under unknown real-world illumination,” in Proceedings of the IEEE Workshop on Identifying Objects across Variation in Lighting: Psychophysics and Computation (IEEE, 2001), available at http://web.mit.edu/persci/people/adelson/pub_pdfs/dror_cvpr01_goem.pdf. [PubMed]
  17. R. O. Dror, “Surface reflectance recognition and real-world illumination statistics,” Ph.D. dissertation (Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2002).
  18. R. W. Fleming, R. O. Dror, and E. H. Adelson, “Real-world illumination and the perception of surface reflectance properties,” J. Vision 3, 347-368 (2003). [CrossRef]
  19. R. Robilotto and Q. Zaidi, “Limits of lightness identification of real objects under natural viewing conditions,” J. Vision 4, 779-797 (2004). [CrossRef]
  20. R. Robilotto and Q. Zaidi, “Lightness identification of patterned three-dimensional, real objects,” J. Vision 6, 18-36 (2006). [CrossRef]
  21. J. Beck and S. Prazdny, “Highlights and the perception of glossiness,” Percept. Psychophys. 30, 401-410 (1981). [CrossRef]
  22. F. Pellacini, J. A. Ferwerda, and D. P. Greenberg, “Towards a psychophysically-based light reflection model for image synthesis,” in Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, J.R.Brown and K.Akeley, eds. (ACM Press, 2000), pp. 55-64.
  23. J. T. Todd, J. F. Norman, and E. Mingolla, “Lightness constancy in the presence of specular highlights,” Psychol. Sci. 15, 33-39 (2004). [CrossRef] [PubMed]
  24. B.-T. Phong, “Illumination for computer generated pictures,” Commun. ACM 18, 311-317 (1975). [CrossRef]
  25. Y. Sato, M. D. Wheeler, and K. Ikeuchi, “Object shape and reflectance modeling from observation,” in Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, G.O.Owen, T.Whitted, and B.Mones-Hattal, eds. (ACM Press, 1997), pp. 379-387.
  26. Y. Yu and J. Malik, “Recovering photometric properties of architectural scenes from photographs,” in Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, S.Cunningham, W.Bransford, and M.F.Cohen, eds. (ACM Press, 1998), pp. 207-217.
  27. S. R. Marschner, S. H. Westin, E. P. F. Lafortune, K. E. Torrance, and D. P. Green, “Image-based BRDF measurement including human skin,” in Proceedings of the 10th Eurographics Workshop on Rendering, D.Lischinski and G.W.Larson, eds. (Springer, 1999), pp. 139-152.
  28. Y. Yu, P. Debevec, J. Malik, and T. Hawkins, “Inverse global illumination: recovering reflectance models of real scenes from photographs,” in Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, W.Waggenspack, ed. (ACM Press, 1999), pp. 215-224.
  29. S. Boivin and A. Gagalowicz, “Image based rendering of diffuse, specular and glossy surfaces from a single image,” in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, L.Pocock, ed. (ACM Press, 2001), pp. 107-116.
  30. S. Tominaga and N. Tanaka, “Estimating reflection parameters from a single color image,” IEEE Comput. Graphics Appl. 20, 58-66 (2000). [CrossRef]
  31. K. Nishino, Z. Zhang, and K. Ikeuchi, “Determining reflectance parameters and illumination distributions from a sparse set of images for view-dependent image synthesis,” in Proceedings of IEEE International Conference on Computer Vision (IEEE, 2001), pp. 599-601.
  32. R. Ramamoorthi and P. Hanrahan, “A signal processing framework for inverse rendering,” in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, L.Pocock, ed. (ACM Press, 2001), pp. 117-128.
  33. P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, “Acquiring the reflectance field of a human face,” in Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, J.R.Brown and K.Akeley, eds. (ACM Press, 2000), pp. 145-156.
  34. P. Debevec, C. Tchou, A. Gardner, T. Hawkins, C. Poullis, J. Stumpfel, A. Jones, N. Yun, P. Einarsson, T. Lundgren, M. Fajardo, and P. Martinez, “Estimating surface reflectance properties of a complex scene under captured natural illumination,” Tech. Rep. ICT-TR-06 (University of Southern California Institute for Creative Technologies Graphics Laboratory, 2004).
  35. J. J. Koenderink, A. J. Van Doorn, K. J. Dana, and S. Nayar, “Bidirectional reflectance distribution function of thoroughly pitted surfaces,” Int. J. Comput. Vis. 31, 129-144 (1999). [CrossRef]
  36. J. J. Koenderink and A. J. van Doorn, “Illuminance texture due to surface mesostructure,” J. Opt. Soc. Am. A 13, 452-463 (1996). [CrossRef]
  37. D. Coffin, “Raw digital photo decoding in Linux,” http://www.cybercom.net/~dcoffin/dcraw.
  38. P. Debevec, C. Tchou, and T. Hawkins, “HDRShop: high dynamic range image processing and manipulation,” http://www.hdrshop.com.
  39. P. Burt and E. H. Adelson, “Laplacian pyramid as a compact image code,” IEEE Trans. Commun. 31, 532-540 (1983). [CrossRef]
  40. E. P. Simoncelli and W. T. Freeman, “The steerable pyramid: a flexible architecture for multi-scale derivative computation,” in Proceedings of IEEE Conference on Image Processing (IEEE, 1995), pp. 444-447. [CrossRef]
  41. C.-C. Chang and C.-J. Lin, “LIBSVM: a library for support vector machines,” http://www.csie.ntu.edu.tw/~cjlin/libsvm.
  42. Columbia-Utrecht Reflectance and Texture (CURET) database, http://www.cs.columbia.edu/CAVE/curet.
  43. D. J. Heeger and J. R. Bergen, “Pyramid-based texture analysis/synthesis,” in Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, R.Cook, ed. (ACM Press, 1995), pp. 229-238.
  44. M. D. Rutherford and D. H. Brainard, “Lightness constancy: a direct test of the illumination estimation hypothesis,” Psychol. Sci. 13, 142-149 (2002). [CrossRef] [PubMed]
  45. C. Chubb, M. S. Landy, and J. Econopouly, “A visual mechanism tuned to black,” Vision Res. 44, 3223-3232 (2004). [CrossRef] [PubMed]
  46. B. A. Olshausen and D. J. Field, “Emergence of simple-cell receptive field properties by learning a sparse code for natural images,” Nature 381, 607-609 (1996). [CrossRef] [PubMed]
  47. E. P. Simoncelli and B. A. Olshausen, “Natural image statistics and neural representation,” Annu. Rev. Neurosci. 24, 1193-1216 (2001). [CrossRef] [PubMed]
  48. M. Varma and A. Zisserman, “A statistical approach to texture classification from single images,” Int. J. Comput. Vis. 62, 61-81 (2005).
  49. M. Oren and S. K. Nayar, “Generalization of the Lambertian model and implications for machine vision,” Int. J. Comput. Vis. 14, 227-251 (1995). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited