OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Editor: Stephen A. Burns
  • Vol. 22, Iss. 10 — Oct. 1, 2005
  • pp: 2039–2049

Contrast statistics for foveated visual systems: fixation selection by minimizing contrast entropy

Raghu Raj, Wilson S. Geisler, Robert A. Frazor, and Alan C. Bovik  »View Author Affiliations


JOSA A, Vol. 22, Issue 10, pp. 2039-2049 (2005)
http://dx.doi.org/10.1364/JOSAA.22.002039


View Full Text Article

Acrobat PDF (756 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

The human visual system combines a wide field of view with a high-resolution fovea and uses eye, head, and body movements to direct the fovea to potentially relevant locations in the visual scene. This strategy is sensible for a visual system with limited neural resources. However, for this strategy to be effective, the visual system needs sophisticated central mechanisms that efficiently exploit the varying spatial resolution of the retina. To gain insight into some of the design requirements of these central mechanisms, we have analyzed the effects of variable spatial resolution on local contrast in 300 calibrated natural images. Specifically, for each retinal eccentricity (which produces a certain effective level of blur), and for each value of local contrast observed at that eccentricity, we measured the probability distribution of the local contrast in the unblurred image. These conditional probability distributions can be regarded as posterior probability distributions for the "true" unblurred contrast, given an observed contrast at a given eccentricity. We find that these conditional probability distributions are adequately described by a few simple formulas. To explore how these statistics might be exploited by central perceptual mechanisms, we consider the task of selecting successive fixation points, where the goal on each fixation is to maximize total contrast information gained about the image (i.e., minimize total contrast uncertainty). We derive an entropy minimization algorithm and find that it performs optimally at reducing total contrast uncertainty and that it also works well at reducing the mean squared error between the original image and the image reconstructed from the multiple fixations. Our results show that measurements of local contrast alone could efficiently drive the scan paths of the eye when the goal is to gain as much information about the spatial structure of a scene as possible.

© 2005 Optical Society of America

OCIS Codes
(110.2960) Imaging systems : Image analysis
(330.0330) Vision, color, and visual optics : Vision, color, and visual optics
(330.1800) Vision, color, and visual optics : Vision - contrast sensitivity
(330.2210) Vision, color, and visual optics : Vision - eye movements
(330.4060) Vision, color, and visual optics : Vision modeling
(330.6110) Vision, color, and visual optics : Spatial filtering

ToC Category:
Visual Coding and Natural Scene Statistics

Citation
Raghu Raj, Wilson S. Geisler, Robert A. Frazor, and Alan C. Bovik, "Contrast statistics for foveated visual systems: fixation selection by minimizing contrast entropy," J. Opt. Soc. Am. A 22, 2039-2049 (2005)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-22-10-2039


Sort:  Author  |  Year  |  Journal  |  Reset

References

  1. S. B. Laughlin, "A simple coding procedure enhances a neuron's information capacity," Z. Naturforsch. C 36, 910-912 (1981).
  2. D. J. Field, "Relations between the statistics of natural images and the response properties of cortical cells," J. Opt. Soc. Am. A 4, 2379-2394 (1987).
  3. D. J. Tolhurst, Y. Tadmor, and T. Chao, "Amplitude spectra of natural images," Ophthalmic Physiol. Opt. 12, 229-232 (1992).
  4. J. J. Atick and A. N. Redlich, "What does the retina know about natural scenes?" Neural Comput. 4, 196-210 (1992).
  5. J. H. van Hateren, "Real and optimal neural images in early vision," Nature 360, 68-70 (1992).
  6. D. L. Ruderman, "The statistics of natural images," Network Comput. Neural Syst. 5, 517-548 (1994).
  7. J. H. van Hateren and A. van der Schaaf, "Independent component filters of natural images compared with simple cells in primary visual cortex," Proc. R. Soc. London, Ser. B 265, 359-366 (1998).
  8. A. J. Bell and T. J. Sejnowski, "The 'independent components' of natural scenes are edge filters," Vision Res. 37, 3327-3338 (1997).
  9. B. A. Olshausen and D. J. Field, "Sparse coding with an overcomplete basis set: a strategy by V1?" Vision Res. 37, 3311-3325 (1997).
  10. W. S. Geisler, J. S. Perry, B. J. Super, and D. P. Gallogly, "Edge co-occurrence in natural images predicts contour grouping performance," Vision Res. 41, 711-724 (2001).
  11. D. Purves and R. B. Lotto, Why We See What We Do: An Empirical Theory of Vision (Sinauer, 2003).
  12. E. P. Simoncelli and B. A. Olshausen, "Natural image statistics and neural representation," Annu. Rev. Neurosci. 24, 1193-1215 (2001).
  13. W. S. Geisler and R. Diehl, "Bayesian natural selection and the evolution of perceptual systems," Philos. Trans. R. Soc. London, Ser. B 357, 419-448 (2002).
  14. Y. Tadmor and D. J. Tolhurst, "Calculating the contrasts that retinal ganglion cells and LGN neurones encounter in natural scenes," Vision Res. 40, 3145-3157 (2000).
  15. N. Brady and D. J. Field, "Local contrast in natural images: normalization and coding efficiency," Perception 29, 1041-1055 (2000).
  16. P. L. Clatworthy, M. Chirimuuta, J. S. Lauritzen, and D. J. Tolhurst, "Coding of the contrasts in natural images by populations of neurons in primary visual cortex (VI)," Vision Res. 43, 1983-2001 (2003).
  17. R. M. Balboa and N. M. Grzywacz, "Power spectra and distribution of contrasts of natural images from different habitats," Vision Res. 43, 2527-2537 (2003).
  18. P. Reinagel and A. M. Zador, "Natural scene statistics at the centre of gaze," Network Comput. Neural Syst. 10, 1-10 (1999).
  19. D. Geman and B. Jedynak, "An active testing model for tracking roads in satellite images," IEEE Trans. Pattern Anal. Mach. Intell. 18, 1-14 (1996).
  20. T. S. Lee and S. Yu, "An information-theoretic framework for understanding saccadic behaviors," in Advances in Neural Information Processing Systems, S.A.Solla, T.K.Leen, and K.-R.Muller, eds. (MIT Press, 2000) Vol. 12, pp. 834-840.
  21. G. E. Legge, T. A. Hooven, T. S. Klitz, J. G. Mansfield, and B. S. Tjan, "Mr. Chips 2002: new insights from an ideal observer model of reading," Vision Res. 42, 2219-2234 (2002).
  22. L. W. Renninger, J. Coughlan, P. Verghese, and J. Malik, "An information maximization model of eye movements," in Advances in Neural Information Processing Systems 17, L. K.Saul, Y.Weiss, and L.Bottou, eds. (MIT Press, 2005), pp. 1121-1128.
  23. J. G. Robson and N. Graham, "Probability summation and regional variation in contrast sensitivity across the visual field," Vision Res. 21, 409-418 (1981).
  24. M. S. Banks, A. B. Sekuler, and S. J. Anderson, "Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling," J. Opt. Soc. Am. A 8, 1775-1787 (1991).
  25. T. L. Arnow and W. S. Geisler, "Visual detection following retinal damage: predictions of an inhomogeneous retino-cortical model," Proc. SPIE 2674, 119-130 (1996).
  26. W. S. Geisler and J. S. Perry, "A real-time foveated multi-resolution system for low-bandwidth video communication," Proc. SPIE 3299, 294-305 (1998).
  27. D. C. Hood and M. A. Finkelstein, "Sensitivity to light," in Handbook of Perception and Human Performance, K.R.Boff, L.Kaufman, and J.P.Thomas, eds. (Wiley, 1986), Vol. 1.
  28. T. Cover and J. Thomas, Elements of Information Theory (Wiley, 1991).
  29. O. Schwartz and E. P. Simoncelli, "Natural signal statistics and sensory gain control," Nat. Neurosci. 4, 819-825 (2001).
  30. U. Rajashekar, L. K. Cormack, and A. C. Bovik, "Visual search: structure from noise," in Proceedings of Eye Tracking Research & Applications, ACM SIGGRAPH2002, A.T.Duchowski, ed. pp. 119-123 (www.siggrraph.org).
  31. J. Najemnik and W. S. Geisler, "Optimal eye movement strategies in visual search," Nature 434, 387-391 (2005).
  32. A. L. Yarbus, Eye Movements and Vision (Plenum, 1967).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited