OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Editor: Franco Gori
  • Vol. 27, Iss. 3 — Mar. 1, 2010
  • pp: 613–621

Saliency of color image derivatives: a comparison between computational models and human perception

Eduard Vazquez, Theo Gevers, Marcel Lucassen, Joost van de Weijer, and Ramon Baldrich  »View Author Affiliations


JOSA A, Vol. 27, Issue 3, pp. 613-621 (2010)
http://dx.doi.org/10.1364/JOSAA.27.000613


View Full Text Article

Enhanced HTML    Acrobat PDF (764 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

In this paper, computational methods are proposed to compute color edge saliency based on the information content of color edges. The computational methods are evaluated on bottom-up saliency in a psychophysical experiment, and on a more complex task of salient object detection in real-world images. The psychophysical experiment demonstrates the relevance of using information theory as a saliency processing model and that the proposed methods are significantly better in predicting color saliency (with a human-method correspondence up to 74.75% and an observer agreement of 86.8%) than state-of-the-art models. Furthermore, results from salient object detection confirm that an early fusion of color and contrast provide accurate performance to compute visual saliency with a hit rate up to 95.2%.

© 2010 Optical Society of America

OCIS Codes
(110.2960) Imaging systems : Image analysis
(330.1720) Vision, color, and visual optics : Color vision
(330.1880) Vision, color, and visual optics : Detection
(330.5510) Vision, color, and visual optics : Psychophysics
(150.1135) Machine vision : Algorithms

ToC Category:
Vision, Color, and Visual Optics

History
Original Manuscript: June 19, 2009
Revised Manuscript: December 22, 2009
Manuscript Accepted: December 25, 2009
Published: February 26, 2010

Virtual Issues
Vol. 5, Iss. 6 Virtual Journal for Biomedical Optics

Citation
Eduard Vazquez, Theo Gevers, Marcel Lucassen, Joost van de Weijer, and Ramon Baldrich, "Saliency of color image derivatives: a comparison between computational models and human perception," J. Opt. Soc. Am. A 27, 613-621 (2010)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-27-3-613


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. E. Titchener, Lectures on the Elementary Psychology of Feeling and Attention (Adamant Media Corporation, 2005).
  2. A. Koene and L. Zhaoping, “Feature-specific interactions in salience from combined feature contrasts: evidence for a bottom-up saliency map in V1,” J. Vision 7(7), 6 (2007). [CrossRef]
  3. A. Torralba, A. Oliva, M. Castelhano, and J. Henderson, “Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search,” Psychol. Rev. 113, 766-786 (2006). [CrossRef] [PubMed]
  4. T. Kadir, A. Zisserman, and M. Brady, “An affine invariant salient region detector,” in European Conference on Computer Vision, 2004, pp. 228-241.
  5. G. Fritz, C. Seifert, L. Paletta, and H. Bischof, “Attentive object detection using an information theoretic saliency measure,” in Attention and Performance in Computational Vision: Second International Workshop, WAPCV 2004, Revised Selected Papers, 2005, pp. 29-41. [CrossRef]
  6. M. Mancas, B. Unay, B. Gosselin, and D. Macq, “Computational attention for defect localisation,” in Proceedings of ICVS Workshop on Computational Attention & Applications, 2007.
  7. N. Bruce and J. Tsotsos, “Saliency based on information maximization,” Adv. Neural Inf. Process. Syst. 18, 155-162 (2006).
  8. D. Gao and N. Vasconcelos, “Discriminant saliency for visual recognition from cluttered scenes,” Adv. Neural Inf. Process. Syst. 17, 481-488 (2005).
  9. D. Gao, V. Mahadevan, and N. Vasconcelos, “On the plausibility of the discriminant center-surround hypothesis for visual saliency,” J. Vision 8(7), 13 (2008). [CrossRef]
  10. L. Zhang, M. Tong, T. Marks, H. Shan, and G. Cottrell, “SUN: a Bayesian framework for saliency using natural statistics,” J. Vision 8(7), 32 (2008). [CrossRef]
  11. D. Gao and J. Zhou, “Adaptive background estimation for real-time traffic monitoring,” in 2001 IEEE Intelligent Transportation Systems, 2001, pp. 330-333.
  12. T. Jost, N. Ouerhani, R. Wartburg, R. Muri, and H. Hugli, “Assessing the contribution of color in visual attention,” Comput. Vis. Image Underst. 100, 107-123 (2005). [CrossRef]
  13. F. Wichmann, L. Sharpe, and K. Gegenfurtner, “The contributions of color to recognition memory for natural scenes,” Learn. Memory 28, 509-520 (2002). [CrossRef]
  14. J. Wolfe and T. Horowitz, “What attributes guide the deployment of visual attention and how do they do it?” Nat. Rev. Neurosci. 5, 495-501 (2004). [CrossRef] [PubMed]
  15. H. Greenspan, S. Belongie, R. Goodman, P. Perona, S. Rakshit, and C. Anderson, “Overcomplete steerable pyramid filters and rotation invariance,” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1994, pp. 222-228.
  16. L. Itti, C. Koch, and E. Niebur, “A model of saliency-based visual attention for rapid scene analysis,” IEEE Trans. Pattern Anal. Mach. Intell. 20, 1254-1259 (1998). [CrossRef]
  17. J. Wolfe, “Guided Search 4.0: current progress with a model of visual search,” in Integrated Models of Cognitive Systems, 2007, pp. 99-119.
  18. Z. Li, “A saliency map in primary visual cortex,” Trends Cogn. Sci. 6, 9-16 (2002). [CrossRef] [PubMed]
  19. J. Krummenacher, H. J. Muller, and D. Heller, “Visual search for dimensionally redundant pop-out targets: evidence for parallel-coactive processing of dimensions,” Percept. Psychophys. 63, 901-917 (2001). [CrossRef] [PubMed]
  20. J. van de Weijer, T. Gevers, and A. Bagdanov, “Boosting color saliency in image feature detection,” IEEE Trans. Pattern Anal. Mach. Intell. 28, 150-156 (2006). [CrossRef] [PubMed]
  21. T. Liu, J. Sun, N. Zheng, X. Tang, and H. Shum, “Learning to detect a salient object,” in Proceedings of IEEE Computer Society Conference on Computer and Vision Pattern Recognition, 2007, pp. 1-8.
  22. D. Parkhurst, K. Law, and E. Niebur, “Modeling the role of salience in the allocation of overt visual attention,” Vision Res. 42, 107-123 (2002). [CrossRef] [PubMed]
  23. M. J. Wright, “Saliency predicts change detection in pictures of natural scenes,” Spatial Vis. 18, 413-430 (2005). [CrossRef]
  24. H. C. Nothdurft, “Salience from feature contrast: additivity across dimensions,” Vision Res. 40, 1183-1201 (2000). [CrossRef] [PubMed]
  25. G. Wyszecki and W. Stiles, Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd ed., 2000, p. 968.
  26. M. Lucassen, P. Bijl, and J. Roelofsen, “The perception of static colored noise: detection and masking described by CIE94,” Color Res. Appl. 33, 178-191 (2008). [CrossRef]
  27. M. Stokes, M. Anderson, S. Chandrasekar, and R. Motta, “A standard default color space for the Internet sRGB,” Microsoft and Hewlett-Packard Joint Report, Version 1, 1996.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited