OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A


  • Editor: Stephen A. Burns
  • Vol. 23, Iss. 5 — May. 1, 2006
  • pp: 1008–1020

Reevaluation of color constancy algorithm performance

Steven D. Hordley and Graham D. Finlayson  »View Author Affiliations

JOSA A, Vol. 23, Issue 5, pp. 1008-1020 (2006)

View Full Text Article

Enhanced HTML    Acrobat PDF (538 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



The relative performance of color constancy algorithms is evaluated. We highlight some problems with previous algorithm evaluation and define more appropriate testing procedures. We discuss how best to measure algorithm accuracy on a single image as well as suitable methods for summarizing errors over a set of images. We also discuss how the relative performance of two or more algorithms should best be compared, and we define an experimental framework for testing algorithms. We reevaluate the performance of six color constancy algorithms using the procedures that we set out and show that this leads to a significant change in the conclusions that we draw about relative algorithm performance as compared with those from previous work.

© 2006 Optical Society of America

OCIS Codes
(150.0150) Machine vision : Machine vision
(330.1690) Vision, color, and visual optics : Color

ToC Category:
Machine Vision

Original Manuscript: June 10, 2005
Revised Manuscript: September 29, 2005
Manuscript Accepted: October 4, 2005

Virtual Issues
Vol. 1, Iss. 6 Virtual Journal for Biomedical Optics

Steven D. Hordley and Graham D. Finlayson, "Reevaluation of color constancy algorithm performance," J. Opt. Soc. Am. A 23, 1008-1020 (2006)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. D. H. Brainard, W. A. Brunt, and J. M. Speigle, "Color constancy in the nearly natural image. 1. Asymmetric matches," J. Opt. Soc. Am. A 14, 2091-2110 (1997). [CrossRef]
  2. D. H. Brainard, "Color constancy in the nearly naturalimage. 2. Achromatic loci," J. Opt. Soc. Am. A 15, 307-325 (1998). [CrossRef]
  3. M. Lucassen, "Quantitative studies of color constancy," Ph.D. thesis (Utrecht University, 1993).
  4. L. Arend and A. Reeves, "Simultaneous color constancy," J. Opt. Soc. Am. A 3, 1743-1751 (1986). [CrossRef] [PubMed]
  5. E. H. Land, "The retinex theory of color vision," Sci. Am. 237, 108-129 (1977). [CrossRef] [PubMed]
  6. G. Buchsbaum, "A spatial processor model for object colour perception," J. Franklin Inst. 310, 1-26 (1980). [CrossRef]
  7. R. Gershon, A. D. Jepson, and J. K. Tsotsos, "From [R,G,B] to surface reflectance: computing color constant descriptors in images," in Proceeding of the International Joint Conference on Artificial Intelligence, Milan, Italy (IEEE, 1987), Vol. 2, pp. 755-758.
  8. L. T. Maloney and B. A. Wandell, "Color constancy: a method for recovering surface spectral reflectance," J. Opt. Soc. Am. A 3, 29-33 (1986). [CrossRef] [PubMed]
  9. S. A. Shafer, "Using color to separate reflection components," Color Res. Appl. 10, 210-218 (1985). [CrossRef]
  10. Hsien-Che Lee, "Method for computing scene-illuminant chromaticity from specular highlights," in Color, G.E.Healey, S.A.Shafer, and L.B.Wolff, eds. (Jones and Bartlett, 1992), pp. 340-347.
  11. G. Healey, "Estimating spectral reflectance using highlights," in Color, G.E.Healey, S.A.Shafer, and L.B.Wolff, eds. (Jones and Bartlett, 1992), pp. 335-339.
  12. D. A. Forsyth, "A novel algorithm for colour constancy," Int. J. Comput. Vis. 5, 5-36 (1990). [CrossRef]
  13. G. D. Finlayson, S. D. Hordley, and P. M. Hubel, "Color by correlation: a simple, unifying framework for color constancy," IEEE Trans. Pattern Anal. Mach. Intell. 23, 1209-1221 (2001). [CrossRef]
  14. K. Barnard, "Practical colour constancy," Ph.D. thesis (Simon Fraser University, School of Computing Science, 2000).
  15. B. Funt, K. Barnard, and L. Martin, "Is machine colour constancy good enough?" in Proceedings of 5th European Conference on Computer Vision (Springer, 1998), pp. 455-459.
  16. G. D. Finlayson, S. Hordley, and P. Hubel, "Illuminant estimation for object recognition," Color Res. Appl. 27, 260-270 (2002). [CrossRef]
  17. K. Barnard, V. Cardei, and B. Funt, "A comparison of computational color constancy algorithms. I: Methodology and experiments with synethetic images," IEEE Trans. Image Process. 11, 972-984 (2002). [CrossRef]
  18. K. Barnard, L. Martin, A. Coath, and B. Funt, "A comparison of computational color constancy algorithms. II: Experiments with image data," IEEE Trans. Image Process. 11, 985-996 (2002). [CrossRef]
  19. http://www.cs.sfu.ca/~colour/data/colourlowbarconstancylowbartestlowbarimages/index.html.
  20. R. W. G. Hunt, The Reproduction of Colour, 5th ed. (Fountain, 1995).
  21. G. Strang, Linear Algebra and Its Applications (Saunders, 1988).
  22. R. V. Hogg and E. A. Tanis, Probability and Statistical Inference (Prentice Hall, 2001).
  23. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing (Cambridge U. Press, 1992).
  24. B. K. P. Horn, Robot Vision (MIT Press, 1986).
  25. G. D. Finlayson and Ruixia Xu, "Convex programming colour constancy," in Proceedings of Workshop on Color and Photometric Methods in Computer Vision (IEEE, 2003).
  26. V. C. Cardei, B. Funt, and K. Barnard, "Estimating the scene illuminant chromaticity by using a neural network," J. Opt. Soc. Am. A 19, 2374-2386 (2002). [CrossRef]
  27. K. Barnard, L. Martin, and B. Funt, "Colour by correlation in a three dimensional colour space," in Proceedings of the 6th European Conference on Computer Vision (Springer, 2000), pp. 275-289.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


Fig. 1 Fig. 2 Fig. 3
Fig. 4 Fig. 5

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited