OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A


  • Editor: Franco Gori
  • Vol. 31, Iss. 6 — Jun. 1, 2014
  • pp: 1328–1336

Performance of select color-difference formulas in the blue region

R. Shamey, R. Cao, T. Tomasino, S. S. H. Zaidy, K. Iqbal, J. Lin, and S. G. Lee  »View Author Affiliations

JOSA A, Vol. 31, Issue 6, pp. 1328-1336 (2014)

View Full Text Article

Enhanced HTML    Acrobat PDF (723 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



The main objective of this work was to test the performance of major formulas for assessment of small suprathreshold color differences in the blue region. The models examined include CIELAB color space based equations, including CIELAB, CIE94, CIEDE2000, CMC ( l : c ), BFD ( l : c ), and formulas based on more uniform color spaces, such as DIN99d, CAM02-SCD, CAM02-UCS, OSA-GP, and OSA-Eu in comparison against data obtained via visual assessments. For this purpose, a dataset around the CIE high-chroma blue color center, hereafter called NCSU-B2, was developed. The NCSU-B2 dataset comprised 65 textile substrates and a standard, with a mean Δ E ab * color difference of 2.72, ranging from 0.54–5.72. Samples were visually assessed by 26 subjects against the reference gray scale in three separate trials with at least 24 h between assessments. A total of 5070 assessments were obtained. The standardized residual sum of squares (STRESS) index was used to examine the performance of various formulas for this dataset, as well as a previously developed NCSU-B1 low-chroma blue dataset [Color Res. Appl. 36, 27, 2011], and blue centers from other established visual datasets. Results show that formulas based on more recent uniform color spaces provide better agreement with perceptual data compared with models based on CIELAB space.

© 2014 Optical Society of America

OCIS Codes
(330.1690) Vision, color, and visual optics : Color
(330.1730) Vision, color, and visual optics : Colorimetry

ToC Category:
Vision, Color, and Visual Optics

Original Manuscript: December 23, 2013
Revised Manuscript: March 23, 2014
Manuscript Accepted: April 8, 2014
Published: May 29, 2014

Virtual Issues
Vol. 9, Iss. 8 Virtual Journal for Biomedical Optics

R. Shamey, R. Cao, T. Tomasino, S. S. H. Zaidy, K. Iqbal, J. Lin, and S. G. Lee, "Performance of select color-difference formulas in the blue region," J. Opt. Soc. Am. A 31, 1328-1336 (2014)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. K. Witt, “CIE guidelines for coordinated future work on industrial colour-difference evaluation,” Color Res. Appl. 20, 399–403 (1995). [CrossRef]
  2. R. McDonald, “Industrial pass/fail colour matching part 1-preparation of visual colour-matching data,” J. Soc. Dyers Colour. 96, 372–376 (1980). [CrossRef]
  3. D. Strocka, A. Brockes, and W. Paffhausen, “Influence of experimental parameters on the evaluation of color-difference ellipsoids,” Color Res. Appl. 8, 169–175 (1983). [CrossRef]
  4. M. R. Luo and B. Rigg, “Chromaticity-discrimination ellipses for surface colours,” Color Res. Appl. 11, 25–42 (1986). [CrossRef]
  5. D. H. Alman, R. S. Berns, G. D. Snyder, and W. A. Larsen, “Performance testing of color-difference metrics using a color tolerance dataset,” Color Res. Appl. 14, 139–151 (1989). [CrossRef]
  6. R. Berns, D. H. Alman, L. Reniff, G. D. Snyder, and M. R. Balonon-Rosen, “Visual determination of suprathreshold color-difference tolerances using probit analysis,” Color Res. Appl. 16, 297–316 (1991). [CrossRef]
  7. M. Cheung and B. Rigg, “Colour-difference ellipsoids for five CIE colour centres,” Color Res. Appl. 11, 185–195 (1986). [CrossRef]
  8. K. Witt, “Three-dimensional threshold of color-difference perceptibility in painted samples: variability of observers in four CIE color regions,” Color Res. Appl. 12, 128–134 (1987). [CrossRef]
  9. K. Witt, “Geometric relations between scales of small colour differences,” Color Res. Appl. 24, 78–92 (1999). [CrossRef]
  10. K. Witt and G. Döring, “Parametric variations in a threshold color-difference ellipsoid for green painted samples,” Color Res. Appl. 8, 153–163 (1983). [CrossRef]
  11. F. J. J. Clarke, R. McDonald, and B. Rigg, “Modification to the JPC79 colour–difference formula,” J. Soc. Dyers Colour. 100, 128–132 (1984). [CrossRef]
  12. M. R. Luo and B. Rigg, “BFD (l:c) colour-difference formula part 1-development of the formula,” J. Soc. Dyers Colour. 103, 86–94 (1987). [CrossRef]
  13. M. R. Luo and B. Rigg, “BFD (l:c) colour-difference formula part 2-performance of the formula,” J. Soc. Dyers Colour. 103, 126–132 (1987). [CrossRef]
  14. R. Berns, “The mathematical development of CIE TC 1-29 proposed color difference equation: CIELCH,” in Proceedings AIC Colour 93 (1993), pp. C19-11–C19-14.
  15. CIE, “Industrial colour-difference evaluation,” (CIE Central Bureau, 2001).
  16. M. R. Luo, G. Cui, and B. Rigg, “The development of the CIE 2000 colour-difference formula: CIEDE2000,” Color Res. Appl. 26, 340–350 (2001). [CrossRef]
  17. M. Melgosa, “Request for existing experimental datasets on color differences,” Color Res. Appl. 32, 159 (2007). [CrossRef]
  18. R. G. Kuehni, “Color difference formulas: an unsatisfactory state of affairs,” Color Res. Appl. 33, 324–326 (2008). [CrossRef]
  19. “DIN6176: Farbmetrische Bestimmung von Farbabstanden bei Koroerfarben nach der DIN99-Formael” (DIN: Deutsches Institut für Normung e.V., 2000).
  20. G. Cui, M. R. Luo, B. Rigg, G. Roesler, and K. Witt, “Uniform colour spaces based on the DIN99 colour-difference formula,” Color Res. Appl. 27, 282–290 (2002). [CrossRef]
  21. R. Shamey, D. Hinks, M. Melgosa, R. Luo, G. Cui, R. Huertas, L. Cárdenas, and S. G. Lee, “Evaluation of performance of twelve color-difference formulae using two NCSU experimental datasets,” in The 5th European Conference on Colour in Graphics, Imaging, and Vision and the 12th International Symposium on Multispectral Colour Science, Joensuu, 2010, pp. 423–428.
  22. D. L. MacAdam, “Uniform color scales,” J. Opt. Soc. Am. 64, 1691–1702 (1974). [CrossRef]
  23. C. Oleari, “Color opponencies in the system of the uniform color scales of the Optical Society of America,” J. Opt. Soc. Am. A 21, 677–682 (2004). [CrossRef]
  24. R. Huertas, M. Melgosa, and C. Oleari, “Performance of a color-difference formula based on OSA–UCS space using small-medium color differences,” J. Opt. Soc. Am. A 23, 2077–2084 (2006). [CrossRef]
  25. C. Oleari, M. Melgosa, and R. Huertas, “Euclidean color-difference formula for small-medium color differences in log-compressed OSA–UCS space,” J. Opt. Soc. Am. A 26, 121–134 (2009). [CrossRef]
  26. M. R. Luo, G. Cui, and C. Li, “Uniform colour spaces based on CIECAM02 colour appearance model,” Color Res. Appl. 31, 320–330 (2006). [CrossRef]
  27. R. Shamey, J. Lin, W. Sawatwarakul, and G. Fang, “Evaluation of performance of several color-difference formulae using a new NCSU black experimental dataset,” in Color and Imaging Conference (2012), pp. 185–190.
  28. S. G. Lee, R. Shamey, D. Hinks, and W. Jasper, “Development of a comprehensive visual dataset based on a CIE blue color center: assessment of color difference formulae using various statistical methods,” Color Res. Appl. 36, 27–41 (2011). [CrossRef]
  29. S. G. Lee, “Assessment of metrics in color spaces,” Master’s Thesis (North Carolina State University, 2007).
  30. J. Neitz, P. Summerfelt, and M. Neitz, “Neitz test for color vision” (Western Psychological Services, 2001).
  31. AATCC Evaluation Procedure 1-2007, “Gray scale for color change” (American Association of Textile Chemists and Colorists, 2007).
  32. P. A. Garcia, R. Huertas, M. Melgosa, and G. Cui, “Measurement of the relationship between perceived and computed color differences,” J. Opt. Soc. Am. A 24, 1823–1829 (2007). [CrossRef]
  33. E. Kirchner and N. Dekker, “Performance measures of color-difference equations: correlation coefficient versus standardized residual sum of squares,” J. Opt. Soc. Am. A 28, 1841–1848 (2011). [CrossRef]
  34. M. Melgosa, P. A. García, L. Gómez-Robledo, R. Shamey, D. Hinks, G. Cui, and M. R. Luo, “Notes on the application of the standardized residual sum of squares index for the assessment of intra- and inter-observer variability in color-difference experiments,” J. Opt. Soc. Am. A 28, 949–953 (2011). [CrossRef]
  35. “ http://home.comcast.net/~sharov/PopEcol/tables/f005.html ,” retrieved April, 2012.
  36. International Organization of Standardization, “Tests for colour fastness—part A05: instrumental assessment of change in colour for determination of grey scale rating,” (ISO, 1996).
  37. A. R. Robertson, “CIE guidelines for coordinated research on color-difference evaluation,” Color Res. Appl. 2, 149–152 (1978).
  38. M. Melgosa, E. Hita, A. J. Poza, D. H. Alman, and R. S. Berns, “Suprathreshold color-difference ellipsoids for surface colors,” Color Res. Appl. 22, 148–155 (1997). [CrossRef]
  39. S. Shen and R. S. Berns, “Evaluating color difference equation performance incorporating visual uncertainty,” Color Res. Appl. 34, 375–390 (2009). [CrossRef]
  40. C. Alder, “A Monte Carlo method for the validation of discrimination ellipse data,” J. Soc. Dyers Colour. 97, 514–517 (1981). [CrossRef]
  41. R. Shamey, L. M. Cardenas, D. Hinks, and R. Woodard, “Comparison of naïve and expert subjects in the assessment of small color differences,” J. Opt. Soc. Am. A 27, 1482–1489 (2010). [CrossRef]
  42. D. H. Kim and J. H. Nobbs, “New weighting function for color difference formula,” AIC Color 97: Proceedings of the 8th Congress of the International Color Association, Kyoto, Japan, 1997, Vol. 1, p. 446.
  43. S. Shen and R. S. Berns, “Color-difference formula performance for several datasets of small color differences based on visual uncertainty,” Color Res. Appl. 36, 15–26 (2011). [CrossRef]
  44. M. Melgosa, R. Huertas, and R. S. Berns, “Performance of recent advanced color-difference formulas using the standardized residual sum of squares index,” J. Opt. Soc. Am. A 25, 1828–1834 (2008). [CrossRef]
  45. CIE, “Parametric effects in color difference evaluation,” (CIE Central Bureau, 1993).
  46. S. Morillas, L. Gómez-Robledo, R. Huertas, and M. Melgosa, “Fuzzy analysis for detection of inconsistent data in experimental datasets employed in the development of the CIEDE2000 colour-difference formula,” J. Mod. Opt. 56, 1447–1456 (2009). [CrossRef]
  47. R. McDonald, “The effect of non–uniformity in ANLAB colour space interpretation of visual colour differences on the interpretation of visual colour differences,” J. Soc. Dyers Colour. 90, 189–198 (1974). [CrossRef]
  48. M. Melgosa, E. Hita, J. Romero, and L. J. Delbarco, “Color-discrimination thresholds translated from the CIE (x,y,Y) space to the CIE 1976 (L*, a*, b*),” Color Res. Appl. 19, 10–18 (1994).
  49. M. Huang, H. Liu, G. Cui, M. R. Luo, and M. Melgosa, “Evaluation of threshold color differences using printed samples,” J. Opt. Soc. Am. A 29, 883–891 (2012). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited