OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Editor: Stephen A. Burns
  • Vol. 22, Iss. 10 — Oct. 1, 2005
  • pp: 2050–2059

Spatiochromatic statistics of natural scenes: first- and second-order information and their correlational structure

Aaron P. Johnson, Frederick A. Kingdom, and Curtis L. Baker Jr.  »View Author Affiliations


JOSA A, Vol. 22, Issue 10, pp. 2050-2059 (2005)
http://dx.doi.org/10.1364/JOSAA.22.002050


View Full Text Article

Acrobat PDF (812 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Spatial filters that mimic receptive fields of visual cortex neurons provide an efficient representation of achromatic image structure, but the extension of this idea to chromatic information is at an early stage. Relatively few studies have looked at the statistical relationships between the modeled responses to natural scenes of the luminance (LUM), red-green (RG), and blue-yellow (BY) postreceptoral channels of the primate visual system. Here we consider the correlations among these channel responses in terms of pixel, first-order, and second-order information. First-order linear filtering was implemented by convolving the cosine-windowed images with oriented Gabor functions, whose gains were scaled to give equal amplitude response across spatial frequency to random fractal images. Second-order filtering was implemented via a filter-rectify-filter cascade, with Gabor functions for both first- and second-stage filters. Both signed and unsigned filter responses were obtained across a range of filter parameters (spatial frequency, 2-64 cycles/image; orientation, 0-135°). The filter responses to the LUM channel images were larger than those for either RG or BY channel images. Cross correlations between the first-order channel responses and between the first- and second-order channel responses were measured. Results showed that the unsigned correlations between first-order channel responses were higher than expected on the basis of previous studies and that first-order channel responses were highly correlated with LUM, but not with RG or BY, second-order responses. These findings imply that course-scale color information correlates well with course-scale changes of fine-scale texture.

© 2005 Optical Society of America

OCIS Codes
(100.2960) Image processing : Image analysis
(330.1720) Vision, color, and visual optics : Color vision
(330.4060) Vision, color, and visual optics : Vision modeling
(330.4270) Vision, color, and visual optics : Vision system neurophysiology
(330.6110) Vision, color, and visual optics : Spatial filtering

ToC Category:
Visual Coding and Natural Scene Statistics

Citation
Aaron P. Johnson, Frederick A. Kingdom, and Curtis L. Baker Jr., "Spatiochromatic statistics of natural scenes: first- and second-order information and their correlational structure," J. Opt. Soc. Am. A 22, 2050-2059 (2005)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-22-10-2050


Sort:  Author  |  Year  |  Journal  |  Reset

References

  1. D. ReganHuman Perception of Objects (Sinauer, 2000).
  2. D. L. Ruderman, T. W. Cronin, and C.-C. Chiao, "Statistics of cone responses to natural images: implications for visual coding," J. Opt. Soc. Am. A 15, 2036-2045 (1998).
  3. C. A. Parraga, G. Brelstaf, T. Troscianko, and I. R. Moorehead, "Color and luminance information in natural scenes," J. Opt. Soc. Am. A 15, 563-569 (1998).
  4. C. A. Parraga, T. Troscianko, and D. J. Tolhurst, "Spatiochromatic properties of natural images and human vision," Curr. Biol. 12, 483-487 (2002).
  5. I. Fine, D. A. MacLeod, and G. M. Boynton, "Surface segmentation based on the luminance and color statistics of natural scenes," J. Opt. Soc. Am. A 20, 1283-1291 (2003).
  6. D. J. Field, "Relations between the statistics of natural images and the response profiles of cortical cells," J. Opt. Soc. Am. A 4, 2379-2394 (1987).
  7. D. J. Field, "What is the goal of sensory coding," Neural Comput. 6, 559-601 (1994).
  8. D. J. Tolhurst, Y. Tadmor, and T. Chao, "Amplitude spectra of natural images," Ophthalmic Physiol. Opt. 12, 229-232 (1992).
  9. A. van der Schaaf and J. H. van Hateren, "Modeling the power spectra of natural images: statistics and information," Vision Res. 36, 2759-2770 (1996).
  10. D. J. Field and N. Brady, "Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes," Vision Res. 37, 3367-3384 (1997).
  11. H. B. Barlow, "Single units and sensation: a neuron doctrine for perceptual psychology?" Perception 1, 371-394 (1972).
  12. H. B. Barlow, "Redundancy reduction revisited," Network Comput. Neural Syst. 12, 241-253 (2001).
  13. G. Buchsbaum and A. Gottschalk, "Trichromacy, opponent colour coding and optimum colour information transmission in the retina," Proc. R. Soc. London, Ser. B 220, 89-113 (1983).
  14. B. A. Olshausen and D. J. Field, "Sparse coding with an overcomplete basis set: a strategy employed by V1?" Vision Res. 37, 3311-3325 (1997).
  15. B. A. Olshausen and D. J. Field, "Sparse coding of sensory inputs," Curr. Opin. Neurobiol. 14, 481-487 (2004).
  16. M. G. A. Thomson, "Visual coding and the phase structure of natural scenes," Network Comput. Neural Syst. 10, 123-132 (1999).
  17. M. G. A. Thomson, "Higher-order structure in natural scenes," J. Opt. Soc. Am. A 16, 1549-1553 (1999).
  18. M. G. A. Thomson, "Beats, kurtosis and visual coding," Network Comput. Neural Syst. 12, 271-287 (2001).
  19. J. Krauskopf, D. H. Williams, and D. W. Heeley, "Cardinal directions of color space," Vision Res. 22, 1123-1131 (1982).
  20. A. Bradley, E. Switkes, and K. DeValois, "Orientation and spatial frequency selectivity of adaptation to color and luminance gratings," Vision Res. 28, 841-856 (1988).
  21. K. R. Gegenfurtner and D. C. Kiper, "Contrast detection in luminance and chromatic noise," J. Opt. Soc. Am. A 9, 1880-1888 (1992).
  22. M. J. Sankeralli and K. T. Mullen, "Postreceptoral chromatic detection mechanisms revealed by noise masking in three-dimensional cone contrast space," J. Opt. Soc. Am. A 14, 906-915 (1997).
  23. K. T. Mullen and M. J. Sankeralli, "Evidence for the stochastic independence of the blue-yellow, red-green and luminance detection mechanisms revealed by subthreshold summation," Vision Res. 39, 733-745 (1999).
  24. M. Livingstone and D. H. Hubel, "Anatomy and physiology of a color system in the primate visual cortex," J. Neurosci. 4, 309-356 (1984).
  25. P. Lennie, "Color coding in cortex," in Color Vision: From Genes to Perception, K.R.Gegenfurtner and L.T.Sharpe, eds. (Cambridge Univ. Press, Cambridge, UK, 1999), pp. 235-247.
  26. E. N. Johnson, M. J. Hawken, and Robert Shapley, "The spatial transformation of colour in the primary visual cortex of the macaque monkey," Nat. Neurosci. 4, 409-416 (2001).
  27. R. A. Humanski and H. R. Wilson, "Spatial-frequency adaptation: evidence for a multiple channel model of short-wavelength-sensitive cone spatial vision," Vision Res. 33, 665-675 (1993).
  28. K. T. Mullen and M. A. Losada, "The spatial tuning of color and luminance peripheral vision measured with notch filtered noise masking," Vision Res. 39, 721-731 (1999).
  29. J. M. Rubin and W. A. Richards, "Color vision and image intensities: When are changes material?" Biol. Cybern. 45, 215-226 (1982).
  30. P. Cavanagh, "Vision at equiluminance," in Vision and Visual Dysfunction Volume V: Limits of Vision, J.J.Kulikowski, I.J.Murray, and V.Walsh, eds. (CRC Press, 1991), pp. 234-250.
  31. M. F. Tappen, W. T. Freeman, and E. H. Adelson, "Recovering intrinsic images from a single image," in Advances in Neural Information Processing Systems, (NIPS, MIT Press, 2003), Vol. 15, pp. 1343-1350.
  32. A. Olmos and F. A. A. Kingdom, "A biologically-inspired algorithm for separating reflectance and shading images," Perception 33, 1463-1473.
  33. C. Chubb and G. Sperling, "Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception," J. Opt. Soc. Am. A 5, 1986-2007 (1988).
  34. T. Ledgeway and A. T. Smith, "Evidence for separate motion-detecting mechanisms for first- and second-order motion in human vision," Vision Res. 34, 2727-2740 (1994).
  35. A. T. Smith and T. Ledgeway, "Separate detection of moving luminance and contrast modulations: fact or artefact?" Vision Res. 37, 45-62 (1997).
  36. A. Sutter, G. Sperling, and C. Chubb, "Measuring the spatial frequency selectivity of second-order texture mechanisms," Vision Res. 35, 915-924 (1995).
  37. A. J. Schofield and M. A. Georgeson, "Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour," Vision Res. 39, 2697-2716 (1999).
  38. T. D. Albright, "Form-cue invariant motion processing in primate visual cortex," Science 255, 1141-1143 (1992).
  39. A. Chaudhuri and T. D. Albright, "Neuronal responses to edges defined by luminance vs. temporal texture in macaque area V1," Visual Neurosci. 14, 949-962 (1997).
  40. C. L. Baker, Jr., "Central neural mechanisms for detecting second-order motion" Curr. Opin. Neurobiol. 9, 461-466 (1999).
  41. C. Chubb and M. S. Landy, "Orthogonal distribution analysis: a new approach to the study of texture perception," in Computational Models of Visual Processing, M.S.Landy and J.A.Movshon, eds. (MIT Press, 1991), pp. 291-301.
  42. H. R. Wilson, V. P. Ferrera, and C. Y. O, "A psychophysically motivated model for two-dimensional motion perception," Visual Neurosci. 9, 79-97 (1992).
  43. I. Mareschal and C. L. Baker, Jr., "Temporal and spatial response to second-order stimuli in cat A18," J. Neurophysiol. 80, 2811-2823 (1998).
  44. N. Graham, A. Sutter, and C. Venkatesan, "Spatial-frequency- and orientation-selectivity of simple and complex channels in region segregation," Vision Res. 33, 1893-1911 (1993).
  45. F. A. A. Kingdom and D. R. T. Keeble, "On the mechanism for scale invariance in orientation-defined textures," Vision Res. 39, 1477-1489 (1999).
  46. N. Graham and S. Wolfson, "A note about preferred orientations at the first and second stages of complex (second-order) texture channels," J. Opt. Soc. Am. A 18, 2273-2281 (2001).
  47. N. Prins and F. A. A. Kingdom, "Orientation- and frequency-modulated textures at low depths of modulation are processed by off-orientation and off-frequency texture mechanisms," Vision Res. 42, 705-713 (2002).
  48. N. Graham and A. Sutter, "Spatial summation in simple (Fourier) and complex (non-Fourier) channels in texture segregation," Vision Res. 38, 231-257 (1998).
  49. A. P. Johnson and C. J. Baker, Jr., "First- and second-order information in natural images: a new view of what second-order sees," J. Opt. Soc. Am. A 21, 913-925 (2004).
  50. Y.-X. Zhou and C. L. Baker, Jr., "Spatial properties of envelope responses in area 17 and 18 of the cat," J. Neurophysiol. 75, 1038-1050 (1996).
  51. A. J. Schofield, "What does second-order vision see in an image?" Perception 29, 1071-1086 (2000).
  52. A. P. Johnson and C. J. Baker, Jr., "Sparse coding in first- and second-order filtered images," J. Vision 4, 542 (2004).
  53. A. Olmos and F. A. A. Kingdom, "McGill Calibrated Colour Image database," http://ego.psych.mcgill.ca/labs/mvr/database/database.html (2004).
  54. C. Smith and J. Pokorny, "Spectral sensitivity of the foveal cone photopigments between 400 and 500nm," Vision Res. 15, 161-171 (1975).
  55. C. Norlander and J. J. Koenderink, "Spatial and temporal discrimination ellipsoids in color space," J. Opt. Soc. Am. 73, 1533-1543 (1983).
  56. C. F. Stromeyer III, G. R. Cole, and R. E. Kronauer, "Second-site adaptation in the red-green chromatic pathways," Vision Res. 25, 219-237 (1985).
  57. G. R. Cole, T. Hine, and W. McIlhagga, "Detection mechanisms in L-, M-, and S-cone contrast space," J. Opt. Soc. Am. A 10, 38-51 (1993).
  58. K. Mullen, "The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings," J. Physiol. (London) 359, 381-400 (1985).
  59. N. Sekiguchi, D. R. Williams, and D. H. Brainard, "Aberration-free measurements of the visibility of isoluminant gratings," J. Opt. Soc. Am. A 10, 2105-2117 (1993).
  60. A. B. Poirson and B. A. Wandell, "The appearance of colored patterns: pattern-color separability," J. Opt. Soc. Am. A 12, 2458-2471 (1993).
  61. M. D'Zmura and B. Singer, "Contrast gain control," in Color Vision: From Genes to Perception, K.R.Gegenfurtner and L.T.Sharpe, eds. (Cambridge Univ. Press, Cambridge, UK, 1999), pp. 369-385.
  62. J. G. Daugman, "Uncertainty relations for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters," J. Opt. Soc. Am. A 2, 1160-1169 (1985).
  63. G. J. Burton and I. R. Moorhead, "Color and spatial structure in natural scenes," Appl. Opt. 26, 157-170 (1987).
  64. M. A. Webster and J. D. Mollon, "Adaptation and the color statistics of natural images," Vision Res. 37, 3283-3298 (1997).
  65. J. Golz and D. I. A. MacLeod, "Influence of scene statistics on colour constancy," Nature 415, 637-640 (2002).
  66. F. A. A. Kingdom, S. Rangwala, and K. Hamammji, "Chromatic properties of the colour-shading effect," Vision Res. 45, 1425-1437 (2005).
  67. E. N. Johnson, M. J. Hawken, and R. Shapley, "The spatial transformation of color in the primary visual cortex of the macaque monkey," Nat. Neurosci. 4, 409-416 (2001).
  68. G. D. Horwitz, E. J. Chichilnisky, and T. D. Albright, "Blue-yellow signals are enhanced by spatiotemporal luminance contrast in Macaque VI," J. Neurosci. 93, 2263-2278 (2005).
  69. H. G. Barrow and J. Tenenbaum, "Recovering intrinsic scene characteristics from images," in Computer Vision Systems, A. R. Hanson and E. M. Riseman, eds. (Academic, 1978), pp. 3-26.
  70. F. A. A. Kingdom, "Colour brings relief to human vision," Nat. Neurosci. 6, 641-644 (2003).
  71. F. A. A. Kingdom, C. Beauce, and L. Hunter, "Colour vision brings clarity to shadows," Perception 33, 907-914 (2004).
  72. K. A. Stevens, "The line of curvature constraint and the interpretation of 3D shape from parallel surface contours," in Natural Computation, W.Richards, ed. (MIT Press, 1998), pp. 107-114.
  73. D. Knill, "Contour into texture: information content of surface contours and texture flow," J. Opt. Soc. Am. A 18, 12-35 (2001).
  74. P. Mamassian and M. S. Landy, "Interaction of prior visual constraints," Vision Res. 41, 2653-2668 (2001).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited