OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A


  • Vol. 20, Iss. 7 — Jul. 1, 2003
  • pp: 1292–1303

Statistical correlations between two-dimensional images and three-dimensional structures in natural scenes

Brian Potetz and Tai Sing Lee  »View Author Affiliations

JOSA A, Vol. 20, Issue 7, pp. 1292-1303 (2003)

View Full Text Article

Enhanced HTML    Acrobat PDF (1155 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



In spite of the recent surge in the popularity of statistical approaches to vision, the joint statistics of coregistered range and light-intensity images have gone relatively unexplored. We investigate statistical correlations between images and the surface shapes that produced them. We determine which linear properties of range images can be best predicted from simple computations on intensity information, and we determine those properties of intensity images that best predict range information. We find that significant (up to ρ=0.45) and potentially exploitable correlations exist between linear properties of range and intensity images, and we explore the structure of these correlations.

© 2003 Optical Society of America

OCIS Codes
(150.5670) Machine vision : Range finding
(330.3790) Vision, color, and visual optics : Low vision

Original Manuscript: October 3, 2002
Revised Manuscript: February 10, 2003
Manuscript Accepted: February 10, 2003
Published: July 1, 2003

Brian Potetz and Tai Sing Lee, "Statistical correlations between two-dimensional images and three-dimensional structures in natural scenes," J. Opt. Soc. Am. A 20, 1292-1303 (2003)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. B. K. P. Horn, “Obtaining shape from shading information,” in The Psychology of Computer Vision, P. H. Winston, ed. (McGraw-Hill, New York, 1975), pp. 115–155.
  2. W. T. Freeman, E. C. Pasztor, O. T. Carmicheal, “Learning low-level vision,” Int. J. Comput. Vision 40, 24–57 (2000). [CrossRef]
  3. S. R. Lehky, T. J. Sejnowski, “Network model for shape-from-shading: neural function arises from both receptive and projective fields,” Nature 333, 452–454 (1988). [CrossRef] [PubMed]
  4. B. A. Olshausen, D. J. Field, “Sparse coding with an overcomplete basis set: a strategy employed by V1?” Vision Res. 37, 3311–3325 (1997). [CrossRef]
  5. M. S. Lewicki, B. A. Olshausen, “Probabilistic framework for the adaptation and comparison of image codes,” J. Opt. Soc. Am. A 16, 1587–1601 (1999). [CrossRef]
  6. J. H. van Hateren, A. van der Schaaf, “Independent component filters of natural images compared with simple cells in primary visual cortex,” Proc. R. Soc. London Ser. B 265, 359–366 (1998). [CrossRef]
  7. P. O. Hoyer, A. Hyvrinen, “Independent component analysis applied to feature extraction from colour and stereo images,” Network Comput. Neural Syst. 11, 191–210 (2000). [CrossRef]
  8. D. L. Ruderman, W. Bialek, “Statistics of natural images: scaling in the woods,” Phys. Rev. Lett. 73, 814–817 (1994). [CrossRef] [PubMed]
  9. D. J. Field, “Scale-invariance and self-similar ‘wavelet’ transforms: An analysis of natural scenes and mammalian visual systems,” in Wavelets, Fractals, and Fourier Transforms, M. Farge, J. C. R. Hunt, J. C. Vassilicos, eds. (Clarendon, Oxford, UK, 1993), pp. 151–193.
  10. J. Huang, D. Mumford, “Statistics of natural images and models,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE Computer Society Press, Los Alamitos, Calif., 1999), pp. 541–547.
  11. E. P. Simoncelli, “Modeling the joint statistics of images in the wavelet domain,” in Wavelet Applications in Signal and Image Processing VII, M. A. Unser, A. Aldroubi, A. F. Laine, eds., Proc. SPIE3813, 188–195 (1999). [CrossRef]
  12. C. Q. Howe, D. Purves, “Range image statistics can explain the anomalous perception of length,” Proc. Natl. Acad. Sci. U.S.A. 99, 13184–13188 (2002).
  13. V. S. Ramachandran, “Perception of shape from shading,” Nature 331, 163–166 (1988). [CrossRef] [PubMed]
  14. J. Sun, P. Perona, “Preattentive perception of elementary three dimensional shapes,” Vision Res. 36, 2515–2529 (1996). [CrossRef] [PubMed]
  15. D. J. Field, “What is the goal of sensory coding?” Neural Comput. 6, 559–601 (1994). [CrossRef]
  16. J. Huang, A. B. Lee, D. Mumford, “Statistics of range images,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE Computer Society Press, Los Alamitos, Calif., 2000), pp. 324–331.
  17. E. MacCurdy, ed., The Notebooks of Leonardo da Vinci, Volume II (Reynal & Hitchcock, New York, 1938), p. 332.
  18. C. Wallschlaeger, C. Busic-Snyder, Basic Visual Concepts and Principles for Artists, Architects, and Designers (McGraw Hill, Boston, Mass., 1992).
  19. T. M. Sheffield, D. Meyer, J. Lees, B. Payne, E. L. Harvey, M. J. Zeitlin, G. Kahle, “Geovolume visualization interpretation: a lexicon of basic techniques,” Leading Edge 19, 518–525 (2000). [CrossRef]
  20. J. Coules, “Effect of photometric brightness on judgments of distance,” J. Exp. Psychol. 50, 19–25 (1955). [CrossRef] [PubMed]
  21. H. Egusa, “Effects of brightness, hue, and saturation on perceived depth between adjacent regions in the visual field,” Perception 12, 167–175 (1983). [CrossRef] [PubMed]
  22. I. L. Taylor, F. C. Sumner, “Actual brightness and distance of individual colors when their apparent distance is held constant,” J. Psychol. 19, 79–85 (1945). [CrossRef]
  23. D. G. Myers, Psychology (Worth, New York, 1995).
  24. J. E. Cutting, P. M. Vishton, “Perceiving layout and knowing distances: the integration, relative potency, and contextual use of different information about depth,” in Handbook of Perception and Cognition, Vol 5: Perception of Space and Motion, W. Epstein, S. Rogers, eds. (Academic, San Diego, Calif., 1995), pp. 69–117.
  25. M. Farne, “Brightness as an indicator to distance: relative brightness per se or contrast with the background?” Perception 6, 287–293 (1977). [CrossRef] [PubMed]
  26. M. S. Langer, S. W. Zucker, “Shape-from-shading on a cloudy day,” J. Opt. Soc. Am. A 11, 467–478 (1994). [CrossRef]
  27. P. Mamassian, M. S. Landy, “Observer biases in the 3D interpretation of line drawings,” Vision Res. 38, 2817–2832 (1998). [CrossRef] [PubMed]
  28. T. P. Ryan, Modern Regression Methods (Wiley-Interscience, New York, 1997).
  29. A. Basilevsky, Statistical Factor Analysis and Related Methods (Wiley-Interscience, New York, 1994).
  30. H. D. Vinod, “Canonical ridge and econometrics of joint production,” J. Econometrics 4, 147–166 (1976). [CrossRef]
  31. K. V. Mardia, J. T. Kent, J. M. Bibby, Multivariate Analysis (Academic, London, 1979).
  32. J. Braun, “Shape-from-shading is independent of visual attention and may be a ‘texton’,” Spatial Vision 7, 311–322 (1993). [CrossRef]
  33. T. S. Lee, C. Yang, R. D. Romero, D. Mumford, “Neural activity in early visual cortex reflects behavioral experience and higher order perceptual saliency,” Nat. Neurosci. 5, 589–597 (2002). [CrossRef] [PubMed]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited