OSA's Digital Library

Optics Express

Optics Express

  • Editor: C. Martijn de Sterke
  • Vol. 19, Iss. 9 — Apr. 25, 2011
  • pp: 8151–8166

Correlation between color quality metric predictions and visual appreciation of light sources

Kevin Smet, Wouter R. Ryckaert, Michael R. Pointer, Geert Deconinck, and Peter Hanselaer  »View Author Affiliations

Optics Express, Vol. 19, Issue 9, pp. 8151-8166 (2011)

View Full Text Article

Enhanced HTML    Acrobat PDF (1337 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



Over the past years there has been increasing evidence that the CIE color rendering index Ra fails to correspond to the perceived color quality of many light sources, especially some Light-Emitting-Diodes. Several proposals to update, complement or even replace the CIE Ra have therefore been made. The performance of thirteen color quality metrics was evaluated by calculating the average correlation of the metric predictions with the visual scaling of the perceived color quality obtained in several psychophysical studies. Two aspects of perceived color quality were investigated, appreciation (preference or attractiveness) and naturalness. The memory color quality metric (Sa) of Smet et al. was found to correlate highly with perceived appreciation (r = 0.88). It was found to be statistically better (p<0.0001) at it than all other metrics. The CIE Ra performed the worst. A metric that combines the gamut area index (GAI) and the CIE Ra using an arithmetic mean correlated highly with the perceived naturalness of a light source (r = 0.85). It was found to be statistically better at predicting naturalness than all other metrics (p<0.0001). A negative correlation was found, between the capabilities of a light source’s ability to predict appreciation and naturalness, indicating that a complete description of the color quality of a light source probably requires more than one metric.

© 2011 OSA

OCIS Codes
(230.3670) Optical devices : Light-emitting diodes
(330.5020) Vision, color, and visual optics : Perception psychology
(330.5510) Vision, color, and visual optics : Psychophysics
(330.1715) Vision, color, and visual optics : Color, rendering and metamerism

ToC Category:
Vision, Color, and Visual Optics

Original Manuscript: December 20, 2010
Manuscript Accepted: April 10, 2011
Published: April 14, 2011

Virtual Issues
Vol. 6, Iss. 5 Virtual Journal for Biomedical Optics

Kevin Smet, Wouter R. Ryckaert, Michael R. Pointer, Geert Deconinck, and Peter Hanselaer, "Correlation between color quality metric predictions and visual appreciation of light sources," Opt. Express 19, 8151-8166 (2011)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. D. Nickerson and C. W. Jerome, “Color rendering of light sources: CIE method of specification and its application,” Illum. Eng. 60, 262–271 (1965).
  2. CIE, “Method of Measuring and Specifying Color Rendering Properties of Light Sources,” in CIE13.2–1974(CIE, Vienna, Austria, 1974).
  3. CIE, “Method of Measuring and Specifying Color Rendering Properties of Light Sources,” in CIE13.2–1995(CIE, Vienna, Austria, 1995).
  4. P. Bodrogi, P. Csuti, P. Hotváth, and J. Schanda, “Why does the CIE Color Rendering Index fail for White RGB LED Light Sources?” in CIE Expert Symposium on LED Light Sources: Physical Measurement and Visual and Photobiological Assessment (Tokyo, Japan, 2004).
  5. S. Jost-Boissard, M. Fontoynont, and J. Blanc-Gonnet, “Perceived lighting quality of LED sources for the presentation of fruit and vegetables,” J. Mod. Opt. 56(13), 1420 (2009). [CrossRef]
  6. N. Narendran, and L. Deng, “Color Rendering Properties of LED Light Sources,” in Solid State Lighting II: Proceedings of SPIE (2002).
  7. M. S. Rea and J. P. Freyssinier-Nova, “Color rendering: A tale of two metrics,” Color Res. Appl. 33(3), 192–202 (2008). [CrossRef]
  8. K. A. G. Smet, W. R. Ryckaert, M. R. Pointer, G. Deconinck, and P. Hanselaer, “Memory colors and color quality evaluation of conventional and solid-state lamps,” Opt. Express 18(25), 26229–26244 (2010). [CrossRef] [PubMed]
  9. F. Szabó, J. Schanda, P. Bodrogi, and E. Radkov, “A Comparative Study of New Solid State Light Sources,” in CIE Session 2007 (2007).
  10. T. Tarczali, P. Bodrogi, and J. Schanda, “Color Rendering Properties of LED Sources,” in CIE 2nd LED Measurement Symposium (Gaithersburg, 2001).
  11. Y. Nakano, H. Tahara, K. Suehara, J. Kohda, and T. Yano, “Application of multispectral camera to color rendering simulator ” in Proc. of 10th Congress of the International Color Association (AIC05) (Grenada, Spain, 2005).
  12. CIE, “TC 1-62: Color Rendering of White LED Light Sources,” in CIE 177:2007 (CIE, Vienna, Austria, 2007).
  13. D. B. Judd, “A flattery index for artificial illuminants,” Illum. Eng. 62, 593–598 (1967).
  14. W. A. Thornton, “A validation of the color preference index,” Illum. Eng. 62, 191–194 (1972).
  15. K. Smet, W. R. Ryckaert, M. R. Pointer, G. Deconinck, and P. Hanselaer, “Color appearance rating of familiar real objects,” Color Res. Appl. 36(3), 192–200 (2011). [CrossRef]
  16. W. Davis and Y. Ohno, “Approaches to color rendering measurement,” J. Mod. Opt. 56(13), 1412–1419 (2009). [CrossRef]
  17. Y. Ohno, and W. Davis, “Color Quality and Spectra,” in Photonics Spectra (2008). [PubMed]
  18. J. Schanda, and G. Madár, “Light source quality assessment,” in CIE 26th Session 2007 (CIE, Bejing, China, 2007), pp. D1–72 −75.
  19. F. Szabó, P. Csuti, and J. Schanda, “Color preference under different illuminants—new approach of light source coloour quality,” in Light and Lighting Conference with Special Emphasis on LEDs and Solid State Lighting (CIE, Budapest, Hungary, 2009), pp. PWDAS-43.
  20. X. Guo and K. W. Houser, “A review of color rendering indices and their application to commercial light sources,” Lighting Res. Tech. 36(3), 183–199 (2004). [CrossRef]
  21. M. R. Luo, G. Cui, and C. Li, “Uniform color spaces based on CIECAM02 color appearance model,” Color Res. Appl. 31(4), 320–330 (2006). [CrossRef]
  22. M. R. Luo, “The quality of light sources,” Color. Technol. 127, 75–87 (2011). [CrossRef]
  23. W. Davis and Y. Ohno, “Color quality scale,” Opt. Eng. 49(3), 033602 (2010). [CrossRef]
  24. C. Li, M. R. Luo, B. Rigg, and R. W. G. Hunt, “CMC 2000 chromatic adaptation transform: CMCCAT2000,” Color Res. Appl. 27(1), 49–58 (2002). [CrossRef]
  25. P. Bodrogi, S. Brückner, and T. Q. Khanh, “Ordinal scale based description of color rendering,” Color Res. Appl. n/a (2010).
  26. K. Hashimoto, T. Yano, M. Shimizu, and Y. Nayatani, “New method for specifying color-rendering properties of light sources based on feeling of contrast,” Color Res. Appl. 32(5), 361–371 (2007). [CrossRef]
  27. J. P. Freyssinier-Nova, and M. S. Rea, “A two-metric proposal to specify the color-rendering properties of light sources for retail lighting.,” in Tenth International Conference of Solid-State Lighting, Proceedings of SPIE (San Diego, CA, 2010), p. 77840V.
  28. W. A. Thornton, “Color-discrimination index,” J. Opt. Soc. Am. 62(2), 191–194 (1972). [CrossRef] [PubMed]
  29. S. A. Fotios, “The perception of light sources of different color properties,” (Univ. of Manchester, Inst. of Sci. and Technol., Manchester, UK, 1997).
  30. S. H. Lee, M. H. Lee, and K. I. Sohng, ““Factors of incomplete adaptation for color reproduction considering subjective white point shift for varying illuminant,” IEICE Trans. Fundamentals 91A, 1438–1442 (2008). [CrossRef]
  31. C. L. Sanders, “Color preferences for natural objects,” Illum. Eng. 54, 452–456 (1959).
  32. S. M. Newhall, R. W. Burnham, and J. R. Clark, “Comparison of successive with simultaneous color matching,” J. Opt. Soc. Am. 47(1), 43–54 (1957). [CrossRef]
  33. S. Jost-Boissard, M. Fontoynont, and J. Blanc-Gonnet, Personal communication (2009).
  34. J. Vanrie, Appendix 4: Technical report to the user committee of the IWT-TETRA project (80163): The effect of the spectral composition of a light source on the visual appreciation of a composite objectset (PHL, Diepenbeek, Belgium, 2009), p. 11.
  35. M. S. Rea and J. P. Freyssinier, “Color rendering: Beyond pride and prejudice,” Color Res. Appl. 35(6), 401–409 (2010). [CrossRef]
  36. A. Field, Discovering Statistics Using SPSS (SAGE Publications Ltd, London, UK, 2009).
  37. L. V. Hedges, and I. Olkin, Statistical Methods for Meta-analysis (Academic Press, San Diego, CA, 1985).
  38. L. V. Hedges and J. L. Vevea, “Fixed- and random-effects models in meta-analysis,” Psychol. Methods 3(4), 486–504 (1998). [CrossRef]
  39. J. E. Hunter, and F. L. Schmidt, Methods of Meta-analysis:Correcting Error and Bias in Research Findings (Sage Publications, Inc., Newbury Park, CA, 2004).
  40. X. L. Meng, R. Rosenthal, and D. B. Rubin, “Comparing correlated correlation coefficients,” Psychol. Bull. 111(1), 172–175 (1992). [CrossRef]
  41. D. Farnsworth, The Farnsworth-Munsell 100-Hue Test for the Examination of Color Discrimination (Munsell Color Company, Inc., 1957).
  42. Y. Ohno, “Spectral design considerations for white LED color rendering,” Opt. Eng. 44(11), 111302 (2005). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited