OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 18, Iss. 1 — Jan. 1, 2001
  • pp: 65–77

Chromatic structure of natural scenes

Thomas Wachtler, Te-Won Lee, and Terrence J. Sejnowski  »View Author Affiliations


JOSA A, Vol. 18, Issue 1, pp. 65-77 (2001)
http://dx.doi.org/10.1364/JOSAA.18.000065


View Full Text Article

Acrobat PDF (755 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We applied independent component analysis (ICA) to hyperspectral images in order to learn an efficient representation of color in natural scenes. In the spectra of single pixels, the algorithm found basis functions that had broadband spectra and basis functions that were similar to natural reflectance spectra. When applied to small image patches, the algorithm found some basis functions that were achromatic and others with overall chromatic variation along lines in color space, indicating color opponency. The directions of opponency were not strictly orthogonal. Comparison with principal-component analysis on the basis of statistical measures such as average mutual information, kurtosis, and entropy, shows that the ICA transformation results in much sparser coefficients and gives higher coding efficiency. Our findings suggest that nonorthogonal opponent encoding of photoreceptor signals leads to higher coding efficiency and that ICA may be used to reveal the underlying statistical properties of color information in natural scenes.

© 2001 Optical Society of America

OCIS Codes
(100.2960) Image processing : Image analysis
(330.1690) Vision, color, and visual optics : Color
(330.1720) Vision, color, and visual optics : Color vision
(330.7310) Vision, color, and visual optics : Vision

Citation
Thomas Wachtler, Te-Won Lee, and Terrence J. Sejnowski, "Chromatic structure of natural scenes," J. Opt. Soc. Am. A 18, 65-77 (2001)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-18-1-65


Sort:  Author  |  Year  |  Journal  |  Reset

References

  1. H. B. Barlow, “Possible principles underlying the transformation of sensory messages,” in Sensory Communication, W. A. Rosenblith, ed. (MIT Press, Cambridge, Mass., 1961), pp. 217–234.
  2. B. A. Olshausen and D. J. Field, “Emergence of simple-cell receptive field properties by learning a sparse code for natural images,” Nature 381, 607–609 (1996).
  3. A. J. Bell and T. J. Sejnowski, “The ‘independent components’ of natural scenes are edge filters,” Vision Res. 37, 3327–3338 (1997).
  4. M. S. Lewicki and B. A. Olshausen, “A probablistic framework for the adaptation and comparison of image codes,” J. Opt. Soc. Am. A 16, 1587–1601 (1999).
  5. G. Buchsbaum and A. Gottschalk, “Trichromacy, opponent colours coding and optimum colour information transmission in the retina,” Proc. R. Soc. London Ser. B 220, 89–113 (1983).
  6. D. L. Ruderman, T. W. Cronin, and C.-C. Chiao, “Statistics of cone responses to natural images: implications for visual coding,” J. Opt. Soc. Am. A 15, 2036–2045 (1998).
  7. J. N. Lythgoe and J. C. Partridge, “Visual pigments and the acquisition of visual information,” J. Exp. Biol. 146, 1–20 (1989).
  8. D. R. Williams, N. Sekiguchi, W. Haake, D. Brainard, and O. Packer, “The cost of trichromacy for spatial vision,” in From Pigments to Perception, A. Valberg and B. B. Lee, eds., NATO ASI Series A, Life Sciences, Vol. 203 (Plenum, New York, 1991), pp. 11–22.
  9. D. J. Field, “What is the goal of sensory coding?” Neural Comput. 6, 559–601 (1994).
  10. A. M. Derrington, J. Krauskopf, and P. Lennie, “Chromatic mechanisms in lateral geniculate nucleus of macaque,” J. Physiol. 357, 241–265 (1984).
  11. P. Lennie, J. Krauskopf, and G. Sclar, “Chromatic mechanisms in striate cortex of macaque,” J. Neurosci. 10, 649–669 (1990).
  12. T. Wachtler, T. J. Sejnowski, and T. D. Albright, “Interactions between stimulus and background chromaticities in macaque primary visual cortex,” Invest. Ophthalmol. Visual Sci. Suppl. 40, S641 (1999).
  13. C. Jutten and J. Herault, “Blind separation of sources, part I: an adaptive algorithm based on neuromimetic architecture,” Signal Process. 24, 1–10 (1991).
  14. P. Comon, “Independent component analysis—a new concept?” Signal Process. 36, 287–314 (1994).
  15. A. J. Bell and T. J. Sejnowski, “An information-maximization approach to blind separation and blind deconvolution,” Neural Comput. 7, 1129–1159 (1995).
  16. T.-W. Lee, Independent Component Analysis: Theory and Applications (Kluwer Academic, Boston, Mass., 1998).
  17. T.-W. Lee, M. Girolami, and T. J. Sejnowski, “Independent component analysis using an extended infomax algorithm for mixed sub-gaussian and super-gaussian sources,” Neural Comput. 11, 409–433 (1999).
  18. A. Hyvärinen and E. Oja, “A fast fixed-point algorithm for independent component analysis,” Neural Comput. 9, 1483–1492 (1997).
  19. J. F. Cardoso, “High-order contrasts for independent component analysis,” Neural Comput. 11, 157–192 (1999).
  20. C. A. Párraga, G. Brelstaff, and T. Troscianko, “Color and luminance information in natural scenes,” J. Opt. Soc. Am. A 15, 563–569 (1998). (http://www.crs4.it/~gjb/ftpJOSA. html)
  21. T.-W. Lee, T. Wachtler, and T. Sejnowski, “The spectral independent components of natural scenes,” Tech. Rep. INC-9901 (Institute for Neural Computation, University of California, San Diego, San Diego, Calif., 1999).
  22. M. S. Lewicki and T. J. Sejnowski, “Learning overcomplete representations,” Neural Comput. 12, 337–365 (2000).
  23. A. Stockman, D. I. A. MacLeod, and N. E. Johnson, “Spectral sensitivities of the human cones,” J. Opt. Soc. Am. A 10, 2491–2521 (1993). (http://www-cvrl.ucsd.edu)
  24. D. I. A. MacLeod and R. M. Boynton, “Chromaticity diagram showing cone excitation by stimuli of equal luminance,” J. Opt. Soc. Am. 69, 1183–1186 (1979).
  25. M. A. Webster and J. D. Mollon, “Adaptation and the color statistics of natural images,” Vision Res. 37, 3283–3298 (1997).
  26. G. Wyszecki and W. S. Stiles, Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd ed. (Wiley, New York, 1982).
  27. L. T. Maloney, “Evaluation of linear models of surface spectral reflectance with small number of parameters,” J. Opt. Soc. Am. A 3, 1673–1683 (1986).
  28. J. Romero, A. Garcia-Beltrán, and J. Hernández-Andrés, “Linear basis for representation of natural and artificial illuminants,” J. Opt. Soc. Am. A 14, 1007–1014 (1997).
  29. C.-C. Chiao, T. W. Cronin, and D. Osorio, “Color signals in natural scenes: characteristics of reflectance spectra and effects of natural illuminants,” J. Opt. Soc. Am. A 17, 218–224 (2000).
  30. M. J. Vrhel, R. Gershon, and L. S. Iwan, “Measurement and analysis of object reflectance spectra,” Color Res. Appl. 19, 4–9 (1994).
  31. J. D. Mollon, “‘Tho’ she kneel’d in that place where they grew ...’: the uses and origins of primate colour vision,” J. Exp. Biol. 146, 21–38 (1989).
  32. D. Osorio and M. Vorobyev, “Colour vision as an adaptation to frugivory in primates,” Proc. R. Soc. London Ser. B 263, 593–599 (1996).
  33. D. R. Tailor, L. H. Finkel, and G. Buchsbaum, “Spatiochromatic independent component filters of natural scenes,” Soc. Neurosci. Abstr. 25, 1935 (1999).
  34. M. S. Lewicki, “A flexible prior for independent component analysis,” Neural Comput. (to be published).
  35. K. Kreutz-Delgado, B. D. Rao, K. Engan, T.-W. Lee, and T. J. Sejnowski, “Convex/schurconvex (csc) log-priors and sparse coding,” in 6th Joint Symposium on Neural Computation (Institute for Neural Computation, University of California, San Diego, San Diego, Calif., 1999), Vol. 9, pp. 65–71.
  36. T-W. Lee, M. S. Lewicki, and T. J. Sejnowski, “Unsupervised classification with nongaussian mixture models using ica,” in Advances in Neural Information Processing Systems 11 (MIT Press, Cambridge, Mass., 1999), pp. 508–514.
  37. T. Cover and J. Thomas, eds, Elements of Information Theory (Wiley, New York, 1991), Vol. 1.
  38. D. MacKay, “Maximum likelihood and covariant algorithms for independent component analysis,” Report (University of Cambridge, Cavendish Lab, Cambridge, UK, August 1996).
  39. B. Pearlmutter and L. Parra, “A context-sensitive generalization of ICA,” in Proceedings of the International Conference on Neural Information Processing (Springer, Singapore, 1996), pp. 151–157.
  40. J-F. Cardoso, “Infomax and maximum likelihood for blind source separation,” IEEE Signal Process. Lett. 4 (4), 112–114 (1997).
  41. S. Amari, “Natural gradient works efficiently in learning,” Neural Comput. 10, 251–276 (1998).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited