OSA's Digital Library

Virtual Journal for Biomedical Optics

Virtual Journal for Biomedical Optics

| EXPLORING THE INTERFACE OF LIGHT AND BIOMEDICINE

  • Editors: Andrew Dunn and Anthony Durkin
  • Vol. 7, Iss. 3 — Feb. 29, 2012

Method for estimating the relative contribution of phase and power spectra to the total information in natural-scene patches

David J. Field and Damon M. Chandler  »View Author Affiliations


JOSA A, Vol. 29, Issue 1, pp. 55-67 (2012)
http://dx.doi.org/10.1364/JOSAA.29.000055


View Full Text Article

Enhanced HTML    Acrobat PDF (947 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

A wide variety of recent studies have argued that the human visual system provides an efficient means of processing the information in the natural environment. However, the amount of information (entropy) in the signal can be estimated in a number of ways, and it is has been unclear how much of the information is carried by the different sources of redundancy. The primary difficulty is that there has been no rational way to estimate the entropy of such complex scenes. In this paper, we provide a technique that uses a recent approach to estimating the entropy and dimensionality of natural scenes [D. M. Chandler and D. J. Field, J. Opt. Soc. Am. A 24, 922–941 (2007)] to estimate the amount of information attributable to the power and phase spectra in natural-scene patches. By comparing the entropies of patches that have swapped phase spectra and fixed phase spectra, we demonstrate how to estimate both the amount of information in each type of spectrum and the amount of information that is shared by these spectra (mutual information). We applied this technique to small patches ( 4 × 4 and 8 × 8 ). From our estimates, we show that the power spectrum of 8 × 8 patches carries approximately 54% of the total information, the phase spectrum carries 56%, and 10% is mutual information ( 54 % + 56 % 10 % = 100 % ). This technique is currently limited to relatively small image patches, due to the number of patches currently in our collection (on the order of 10 6 ). However, the technique can, in theory, be extended to larger images. Even with these relatively small patches, we discuss how these results can provide important insights into both compression techniques and efficient coding techniques that work with relatively small image patches (e.g., JPEG, sparse coding, independent components analysis).

© 2012 Optical Society of America

OCIS Codes
(330.1800) Vision, color, and visual optics : Vision - contrast sensitivity
(330.1880) Vision, color, and visual optics : Detection
(330.4060) Vision, color, and visual optics : Vision modeling
(330.5020) Vision, color, and visual optics : Perception psychology
(330.5510) Vision, color, and visual optics : Psychophysics

ToC Category:
Vision, Color, and Visual Optics

History
Original Manuscript: June 10, 2011
Revised Manuscript: September 11, 2011
Manuscript Accepted: October 22, 2011
Published: December 7, 2011

Virtual Issues
Vol. 7, Iss. 3 Virtual Journal for Biomedical Optics

Citation
David J. Field and Damon M. Chandler, "Method for estimating the relative contribution of phase and power spectra to the total information in natural-scene patches," J. Opt. Soc. Am. A 29, 55-67 (2012)
http://www.opticsinfobase.org/vjbo/abstract.cfm?URI=josaa-29-1-55


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. D. J. Field, “Relations between the statistics of natural images and the response properties of cortical cells,” J. Opt. Soc. Am. A 4, 2379–2394 (1987). [CrossRef] [PubMed]
  2. D. J. Field, “Scale-invariance and self-similar ‘wavelet’ transforms: an analysis of natural scenes and mammalian visual systems,” in Wavelets, Fractals and Fourier Transforms: New Developments and New Applications, M.Farge, J.C. R.Hunt, and J.C.Vassilicos, eds. (Oxford University, 1993), pp. 151–193.
  3. D. J. Field, “What is the goal of sensory coding?” Neural Comput. 6, 559–601 (1994). [CrossRef]
  4. B. A. Olshausen and D. J. Field, “Sparse coding with an overcomplete basis set: a strategy employed by V1?” Vis. Res. 37, 3311–3325 (1997). [CrossRef]
  5. E. P. Simoncelli and B. A. Olshausen, “Natural image statistics and neural representation,” Annu. Rev. Neurosci. 24, 1193–1216(2001). [CrossRef] [PubMed]
  6. W. E. Vinje and J. L. Gallant, “Sparse coding and decorrelation in primary visual cortex during natural vision,” Science 287, 1273–1276 (2000). [CrossRef] [PubMed]
  7. A. Bell and T. Sejnowski, “The ‘independent components’ of natural scenes are edge filters,” Vis. Res. 37, 3327–3338 (1997). [CrossRef]
  8. P. O. Hoyer and A. Hyvärinen, “A multi-layer sparse coding network learns contour coding from natural images,” Vis. Res. 42, 1593–1605 (2002). [CrossRef] [PubMed]
  9. L. Wiskott and T. Sejnowski, “Slow feature analysis: unsupervised learning of invariances,” Neural Comput. 14, 715–770(2002). [CrossRef] [PubMed]
  10. W. E. Vinje and J. L. Gallant, “Natural stimulation of the nonclassical receptive field increases information transmission efficiency in V1,” J. Neurosci. 22, 2904–2915 (2002). [PubMed]
  11. P. Garrigues and B. A. Olshausen, “Learning horizontal connections in a sparse coding model of natural images,” in Advances in Neural Information Processing Systems 20, J.C.Platt, D.Koller, Y.Singer, and S.Roweis, eds. (MIT Press, 2008), pp. 505–512.
  12. A. B. Lee, K. S. Pedersen, and D. Mumford, “The nonlinear statistics of high-contrast patches in natural images,” Int. J. Comput. Vis. 54, 83–103 (2003). [CrossRef]
  13. W. B. Pennebaker and J. L. Mitchell, The JPEG Still Image Data Compression Standard (Van Nostrand Reinhold, 1993).
  14. International Organization for Standardization, “Information technology—JPEG 2000 image coding system: core coding system,” Tech. Rep. ISO/IEC FDIS15444-1:2000 (International Organization for Standardization, 2000).
  15. D. M. Chandler and D. J. Field, “Estimates of the information content and dimensionality of natural scenes from proximity distributions,” J. Opt. Soc. Am. A 24, 922–941 (2007). [CrossRef]
  16. R. Hosseini, F. Sinz, and M. Bethge, “Lower bounds on the redundancy of natural images,” Vis. Res. 50, 2213–2222 (2010). [CrossRef] [PubMed]
  17. G. J. Burton and I. R. Moorhead, “Color and spatial structure in natural scenes,” Appl. Opt. 26, 157–170 (1987). [CrossRef] [PubMed]
  18. D. J. Tolhurst, Y. Tadmor, and T. Chao, “Amplitude spectra of natural images,” Ophthalmol. Physiol. Opt. 12, 229–232 (1992). [CrossRef]
  19. A. V. Oppenheim and J. S. Lim, “The importance of phase in signals,” Proc. IEEE 69, 529–541 (1981). [CrossRef]
  20. L. N. Piotrowski and F. W. Campbell, “A demonstration of the visual importance and flexibility of spatial-frequency amplitude and phase,” Perception 11, 337–346 (1982). [CrossRef] [PubMed]
  21. R. P. Millane and W. H. Hsiao, “The basis of phase dominance,” Opt. Lett. 34, 2607–2609 (2009). [CrossRef] [PubMed]
  22. M. J. Morgan, J. Ross, and A. Hayes, “The relative importance of local phase and local amplitude in patchwise image reconstruction,” Biol. Cybern. 65, 113–119 (1991). [CrossRef]
  23. D. L. Ruderman, “Origins of scaling in natural images,” Vis. Res. 37, 3385–3398 (1997). [CrossRef]
  24. W. H. Hsiao and R. P. Millane, “Effects of occlusion, edges, and scaling on the power spectra of natural images,” J. Opt. Soc. Am. A 22, 1789–1797 (2005). [CrossRef]
  25. D. J. Graham and D. J. Field, “Statistical regularities of art images and natural scenes: spectra, sparseness and nonlinearities,” Spatial Vis. 21, 149–64 (2007). PMID: 18073056. [CrossRef]
  26. A. Torralba and A. Oliva, “Statistics of natural image categories,” Network: Comput. Neural Syst. 14, 391–412(2003). [CrossRef]
  27. Y. Tadmor and D. Tolhurst, “Both the phase and the amplitude spectrum may determine the appearance of natural images,” Vis. Res. 33, 141–145 (1993). [CrossRef] [PubMed]
  28. L. F. Kozachenko and N. N. Leonenko, “A statistical estimate for the entropy of a random vector,” Probl. Inf. Transm. 23, 9–16(1987).
  29. J. D. Victor, “Binless strategies for estimation of information from neural data,” Phys. Rev. E 66051903 (2002). [CrossRef]
  30. A. Kraskov, H. Stögbauer, and P. Grassberger, “Estimating mutual information,” Phys. Rev. E 69 (2004). [CrossRef]
  31. J. Kybic, “High-dimensional mutual information estimation for image registration,” in Proceedings of International Conference on Image Processing, 2004, Vol. 3 (IEEE, 2005), pp. 1779–1782.
  32. J. H. van Hateren and A. van der Schaaf, “Independent component filters of natural images compared with simple cells in primary visual cortex,” Proc. R. Soc. Lond. Ser. B 265, 359–366(1998). [CrossRef]
  33. R. M. Gray and D. L. Neuhoff, “Quantization,” IEEE Trans. Inf. Theory 44, 2325–2384 (1998). [CrossRef]
  34. The values of T=65,536 and T=16,384 and ten trials of the search procedure (using ten randomizations of Group T) were sufficient to yield a consistent sample mean.
  35. M. R. Celis, J. E. Dennis, and R. A. Tapia, “A trust region strategy for nonlinear equality constrained optimization,” in Numerical Optimization 1984, P.T.Boggs, R.H.Byrd, and R.B.Schnabel, eds. (SIAM, 1985), pp. 71–82.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited