OSA's Digital Library

Virtual Journal for Biomedical Optics

Virtual Journal for Biomedical Optics

| EXPLORING THE INTERFACE OF LIGHT AND BIOMEDICINE

  • Editor: Gregory W. Faris
  • Vol. 2, Iss. 5 — May. 17, 2007

Estimates of the information content and dimensionality of natural scenes from proximity distributions

Damon M. Chandler and David J. Field  »View Author Affiliations


JOSA A, Vol. 24, Issue 4, pp. 922-941 (2007)
http://dx.doi.org/10.1364/JOSAA.24.000922


View Full Text Article

Enhanced HTML    Acrobat PDF (2597 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Natural scenes, like most all natural data sets, show considerable redundancy. Although many forms of redundancy have been investigated (e.g., pixel distributions, power spectra, contour relationships, etc.), estimates of the true entropy of natural scenes have been largely considered intractable. We describe a technique for estimating the entropy and relative dimensionality of image patches based on a function we call the proximity distribution (a nearest-neighbor technique). The advantage of this function over simple statistics such as the power spectrum is that the proximity distribution is dependent on all forms of redundancy. We demonstrate that this function can be used to estimate the entropy (redundancy) of 3 × 3 patches of known entropy as well as 8 × 8 patches of Gaussian white noise, natural scenes, and noise with the same power spectrum as natural scenes. The techniques are based on assumptions regarding the intrinsic dimensionality of the data, and although the estimates depend on an extrapolation model for images larger than 3 × 3 , we argue that this approach provides the best current estimates of the entropy and compressibility of natural-scene patches and that it provides insights into the efficiency of any coding strategy that aims to reduce redundancy. We show that the sample of 8 × 8 patches of natural scenes used in this study has less than half the entropy of 8 × 8 white noise and less than 60% of the entropy of noise with the same power spectrum. In addition, given a finite number of samples ( < 2 20 ) drawn randomly from the space of 8 × 8 patches, the subspace of 8 × 8 natural-scene patches shows a dimensionality that depends on the sampling density and that for low densities is significantly lower dimensional than the space of 8 × 8 patches of white noise and noise with the same power spectrum.

© 2007 Optical Society of America

OCIS Codes
(100.7410) Image processing : Wavelets
(330.1800) Vision, color, and visual optics : Vision - contrast sensitivity
(330.1880) Vision, color, and visual optics : Detection
(330.5020) Vision, color, and visual optics : Perception psychology
(330.5510) Vision, color, and visual optics : Psychophysics

ToC Category:
Vision and color

History
Original Manuscript: May 30, 2006
Manuscript Accepted: September 29, 2006
Published: March 14, 2007

Virtual Issues
Vol. 2, Iss. 5 Virtual Journal for Biomedical Optics

Citation
Damon M. Chandler and David J. Field, "Estimates of the information content and dimensionality of natural scenes from proximity distributions," J. Opt. Soc. Am. A 24, 922-941 (2007)
http://www.opticsinfobase.org/vjbo/abstract.cfm?URI=josaa-24-4-922

You do not have subscription access to this journal. Citation lists with outbound citation links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

You do not have subscription access to this journal. Article level metrics are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited