OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A


  • Editor: Franco Gori
  • Vol. 29, Iss. 2 — Feb. 1, 2012
  • pp: A194–A199

Visual search in natural scenes explained by local color properties

Kinjiro Amano, David H. Foster, Matthew S. Mould, and John P. Oakley  »View Author Affiliations

JOSA A, Vol. 29, Issue 2, pp. A194-A199 (2012)

View Full Text Article

Enhanced HTML    Acrobat PDF (1625 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



Success in visually searching for a small object or target in a natural scene depends on many factors, including the spatial structure of the scene and the pattern of observers’ eye movements. The aim of this study was to determine to what extent local color properties of natural scenes can account for target-detection performance. A computer-controlled high-resolution color monitor was used to present images of natural scenes containing a small, randomly located, shaded gray sphere, which served as the target. Observers’ gaze position was simultaneously monitored with an infrared video eye-tracker. About 60% of the adjusted variance in observers’ detection performance was accounted for by local color properties, namely, lightness and the red-green and blue-yellow components of chroma. A similar level of variance was accounted for by observers’ fixations. These results suggest that local color can be as influential as gaze position in determining observers’ search performance in natural scenes.

© 2012 Optical Society of America

OCIS Codes
(330.1720) Vision, color, and visual optics : Color vision
(330.1880) Vision, color, and visual optics : Detection
(330.2210) Vision, color, and visual optics : Vision - eye movements

ToC Category:
Color in natural or complex scenes

Original Manuscript: September 1, 2011
Revised Manuscript: November 17, 2011
Manuscript Accepted: November 18, 2011
Published: January 26, 2012

Virtual Issues
Vol. 7, Iss. 4 Virtual Journal for Biomedical Optics

Kinjiro Amano, David H. Foster, Matthew S. Mould, and John P. Oakley, "Visual search in natural scenes explained by local color properties," J. Opt. Soc. Am. A 29, A194-A199 (2012)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. J. M. Wolfe, M. L.-H. Võ, K. K. Evans, and M. R. Greene, “Visual search in scenes involves selective and nonselective pathways,” Trends Cogn. Sci. 15, 77–84 (2011). [CrossRef]
  2. R. van der Lans, R. Pieters, and M. Wedel, “Eye-movement analysis of search effectiveness,” J. Am. Stat. Assoc. 103, 452–461 (2008). [CrossRef]
  3. M. J. Bravo and K. Nakayama, “The role of attention in different visual-search tasks,” Percept. Psychophys. 51, 465–472 (1992). [CrossRef]
  4. J. M. Wolfe, “Visual search in continuous, naturalistic stimuli,” Vision Res. 34, 1187–1195 (1994). [CrossRef]
  5. X. Chen and G. J. Zelinsky, “Real-world visual search is dominated by top-down guidance,” Vision Res. 46, 4118–4133 (2006). [CrossRef]
  6. J. M. Henderson, G. L. Malcolm, and C. Schandl, “Searching in the dark: cognitive relevance drives attention in real-world scenes,” Psychon. B. Rev. 16, 850–856 (2009).
  7. A. Torralba, A. Oliva, M. S. Castelhano, and J. M. Henderson, “Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search,” Psychol. Rev. 113, 766–786 (2006). [CrossRef]
  8. P. G. Lovell, I. D. Gilchrist, D. J. Tolhurst, and T. Troscianko, “Search for gross illumination discrepancies in images of natural objects,” J. Vision 9(1), 37 (2009). [CrossRef]
  9. A. Treisman and S. Sato, “Conjunction search revisited,” J. Exp. Psychol. Hum. Percept. Perform. 16, 459–478 (1990).
  10. A. L. Nagy and G. Thomas, “Distractor heterogeneity, attention, and color in visual search,” Vision Res. 43, 1541–1552 (2003). [CrossRef]
  11. D. H. Foster and P. A. Ward, “Asymmetries in oriented-line detection indicate two orthogonal filters in early vision,” Proc. R. Soc. B 243, 75–81 (1991). [CrossRef]
  12. J. Duncan and G. W. Humphreys, “Visual search and stimulus similarity,” Psychol. Rev. 96, 433–458 (1989). [CrossRef]
  13. D. T. Lindsey, A. M. Brown, E. Reijnen, A. N. Rich, Y. I. Kuzmova, and J. M. Wolfe, “Color channels, not color appearance or color categories, guide visual search for desaturated color targets,” Psychol. Sci. 21, 1208–1214 (2010).
  14. B. L. Cole and K.-Y. Lian, “Search for coloured objects in natural surroundings by people with abnormal colour vision,” Clin. Exp. Optom. 89, 144–149 (2006).
  15. L. Itti, C. Koch, and E. Niebur, “A model of saliency-based visual attention for rapid scene analysis,” IEEE Trans. Pattern Anal. Mach. Intell. 20, 1254–1259 (1998). [CrossRef]
  16. T. Foulsham and G. Underwood, “What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition,” J. Vision 8(2), 6 (2008). [CrossRef]
  17. G. J. Zelinsky, W. Zhang, B. Yu, X. Chen, and D. Samaras, “The role of top-down and bottom-up processes in guiding eye movements during visual search,” in Advances in Neural Information Processing Systems 18, Y. Weiss, B. Schölkopf, and J. Platt, eds. (MIT Press, 2006), pp. 1569–1576.
  18. P. Reinagel and A. M. Zador, “Natural scene statistics at the centre of gaze,” Netw. Comput. Neural Syst. 10, 341–350(1999).
  19. D. J. Parkhurst and E. Niebur, “Scene content selected by active vision,” Spatial Vis. 16, 125–154 (2003). [CrossRef]
  20. W. Einhäuser and P. König, “Does luminance-contrast contribute to a saliency map for overt visual attention?,” Eur. J. Neurosci. 17, 1089–1097 (2003). [CrossRef]
  21. S. K. Mannan, K. H. Ruddock, and D. S. Wooding, “The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images,” Spatial Vis. 10, 165–188 (1996). [CrossRef]
  22. G. Krieger, I. Rentschler, G. Hauske, K. Schill, and C. Zetzsche, “Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics,” Spatial Vis. 13, 201–214 (2000). [CrossRef]
  23. W. Kienzle, F. A. Wichmann, B. Schölkopf, and M. O. Franz, “A nonparametric approach to bottom-up visual saliency,” in Advances in Neural Information Processing Systems 19, B. Schölkopf, J. Platt, and T. Hoffman, eds. (MIT Press, 2007), pp. 689–696.
  24. H.-P. Frey, C. Honey, and P. König, “What’s color got to do with it? The influence of color on visual attention in different categories,” J. Vision 8(14), 6 (2008). [CrossRef]
  25. H.-P. Frey, K. Wirz, V. Willenbockel, T. Betz, C. Schreiber, T. Troscianko, and P. König, “Beyond correlation: do color features influence attention in rainforest?” Front. Hum. Neurosci. 5, 36 (2011).
  26. W. Einhäuser, U. Rutishauser, and C. Koch, “Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli,” J. Vision 8(2), 2 (2008).
  27. B. W. Tatler, “The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions,” J. Vision 7(14), 4(2007). [CrossRef]
  28. D. H. Foster, K. Amano, S. M. C. Nascimento, and M. J. Foster, “Frequency of metamerism in natural scenes,” J. Opt. Soc. Am. A 23, 2359–2372 (2006).
  29. CIE, Technical Committee 1-48, “Colorimetry,” 3rd ed., CIE 15:2004 (Commission Internationale de l’Eclairage, 2004).
  30. H. Corbin, J. Carter, E. P. Reese, and J. Volkmann, Experiments on Visual Search 1956–1957 (Psychological Research Unit, Mount Holyoke College, 1958).
  31. D. M. Green and J. A. Swets, Signal Detection Theory and Psychophysics (Wiley, 1966).
  32. W. S. Cleveland, “Robust locally weighted regression and smoothing scatterplots,” J. Am. Stat. Assoc. 74, 829–836(1979). [CrossRef]
  33. T. J. Hastie and R. J. Tibshirani, Generalized Additive Models, CRC Monographs on Statistics & Applied Probability(Chapman & Hall/CRC, 1990).
  34. M. Böhme, M. Dorr, C. Krause, T. Martinetz, and E. Barth, “Eye movement predictions on natural videos,” Neurocomput. 69, 1996–2004 (2006). [CrossRef]
  35. M. Nyström and K. Holmqvist, “An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data,” Behav. Res. Methods 42, 188–204 (2010). [CrossRef]
  36. E. Vig, M. Dorr, and E. Barth, “Efficient visual coding and the predictability of eye movements on natural movies,” Spatial Vis. 22, 397–408 (2009). [CrossRef]
  37. M. S. Mould, D. H. Foster, K. Amano, and J. P. Oakley, “A simple nonparametric method for classifying eye fixation,” Vision Res. (submitted). doi:10.1016/j.visres.2011.12.006
  38. E. Vig, Institute for Neuro- and Bioinformatics, University of Lübeck, Germany (personal communication, 2010).
  39. M. Melgosa, R. Huertas, and R. S. Berns, “Performance of recent advanced color-difference formulas using the standardized residual sum of squares index,” J. Opt. Soc. Am. A 25, 1828–1834 (2008). [CrossRef]
  40. M. R. Luo, G. Cui, and C. Li, “Uniform colour spaces based on CIECAM02 colour appearance model,” Color Res. Appl. 31, 320–330 (2006). [CrossRef]
  41. CIE, Technical Committee 8-01, “A colour appearance model for colour management systems: CIECAM02,” CIE 159:2004 (Commission Internationale de l’Eclairage, 2004).
  42. M. R. Luo, G. Cui, and B. Rigg, “The development of the CIE 2000 colour-difference formula: CIEDE2000,” Color Res. Appl. 26, 340–350 (2001). [CrossRef]
  43. D. B. Montgomery and D. G. Morrison, “A note on adjusting R2,” J. Finance 28, 1009–1013 (1973).
  44. A. Delorme, G. Richard, and M. Fabre-Thorpe, “Ultra-rapid categorisation of natural scenes does not rely on colour cues: a study in monkeys and humans,” Vision Res. 40, 2187–2200 (2000). [CrossRef]
  45. A. Oliva and P. G. Schyns, “Diagnostic colors mediate scene recognition,” Cogn. Psychol. 41, 176–210 (2000).
  46. D. Parkhurst, K. Law, and E. Niebur, “Modeling the role of salience in the allocation of overt visual attention,” Vision Res. 42, 107–123 (2002). [CrossRef]
  47. T. J. Andrews and D. M. Coppola, “Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments,” Vision Res. 39, 2947–2953(1999). [CrossRef]
  48. M. S. Castelhano and J. M. Henderson, “Stable individual differences across images in human saccadic eye movements,” Can. J. Exp. Psychol. 62, 1–14 (2008). [CrossRef]
  49. D. H. Foster, K. Amano, and S. M. C. Nascimento, “Color constancy in natural scenes explained by global image statistics,” Vis. Neurosci. 23, 341–349 (2006).
  50. P. W. Lucas, N. J. Dominy, P. Riba-Hernandez, K. E. Stoner, N. Yamashita, E. Loría-Calderón, W. Petersen-Pereira, Y. Rojas-Durán, R. Salas-Pena, S. Solis-Madrigal, D. Osorio, and B. W. Darvell, “Evolution and function of routine trichromatic vision in primates,” Evolution 57, 2636–2643 (2003).
  51. P. Sumner and J. D. Mollon, “Catarrhine photopigments are optimized for detecting targets against a foliage background,” J. Exp. Biol. 203, 1963–1986 (2000).
  52. F. A. Wichmann, L. T. Sharpe, and K. R. Gegenfurtner, “The contributions of color to recognition memory for natural scenes,” J. Exp. Psychol. Learn. Mem. Cogn. 28, 509–520(2002).
  53. K. Amano, K. Uchikawa, and I. Kuriki, “Characteristics of color memory for natural scenes,” J. Opt. Soc. Am. A 19, 1501–1514 (2002). [CrossRef]
  54. M. S. Castelhano and J. M. Henderson, “The influence of color on the perception of scene gist,” J. Exp. Psychol. Hum. Percept. Perform. 34, 660–675 (2008).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


Fig. 1. Fig. 2.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited