OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 21, Iss. 12 — Dec. 1, 2004
  • pp: 2301–2310

Estimation of saturated pixel values in digital color imaging

Xuemei Zhang and David H. Brainard  »View Author Affiliations


JOSA A, Vol. 21, Issue 12, pp. 2301-2310 (2004)
http://dx.doi.org/10.1364/JOSAA.21.002301


View Full Text Article

Acrobat PDF (313 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Pixel saturation, in which the incident light at a pixel causes one of the color channels of the camera sensor to respond at its maximum value, can produce undesirable artifacts in digital color images. We present a Bayesian algorithm that estimates what the saturated channel’s value would have been in the absence of saturation. The algorithm uses the nonsaturated responses from the other color channels, together with a multivariate normal prior that captures the correlation in response across color channels. The prior may be estimated directly from the image data, since most image pixels are not saturated. Given the prior and the responses of the nonsaturated channels, the algorithm returns the optimal expected mean square estimate for the true response. Extensions of the algorithm to the case in which more than one channel is saturated are also discussed. Both simulations and examples with real images are presented to show that the algorithm is effective.

© 2004 Optical Society of America

OCIS Codes
(100.2000) Image processing : Digital image processing
(100.3010) Image processing : Image reconstruction techniques
(330.1690) Vision, color, and visual optics : Color

Citation
Xuemei Zhang and David H. Brainard, "Estimation of saturated pixel values in digital color imaging," J. Opt. Soc. Am. A 21, 2301-2310 (2004)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-21-12-2301


Sort:  Author  |  Year  |  Journal  |  Reset

References

  1. P. Longere and D. H. Brainard, “Simulation of digital camera images from hyperspectral input,” in Vision Models and Applications to Image and Video Processing, C. van den Branden Lambrecht, ed. (Kluwer Academic, Boston, Mass., 2001), pp. 123–150.
  2. J. Holm, I. Tastl, L. Hanlon, and P. Hubel, “Color processing for digital photography,” in Colour Engineering: Achieving Device Independent Colour, P. Green and L. MacDonald, eds. (Wiley, New York, 2002), pp. 179–217.
  3. J. Holm, “A strategy for pictorial digital image processing,” in Proceedings of the IS&T/SID 4th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1996), pp. 194–201.
  4. R. Kimmel, “Demosaicing: image reconstruction from color CCD samples,” IEEE Trans. Image Process. 8, 1221–1228 (1999).
  5. R. Kakarala and Z. Baharav, “Adaptive demosaicing with the principal vector method,” IEEE Trans. Consum. Electron. 48, 932–937 (2002).
  6. D. H. Brainard and D. Sherman, “Reconstructing images from trichromatic samples: from basic research to practical applications,” in Proceedings of the 3rd IS&T/SID Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1995), pp. 4–10.
  7. B. Tao, I. Tastl, T. Cooper, M. Blasgen, and E. Edwards, “Demosaicing using human visual properties and wavelet interpolation filtering,” in Proceedings of the IS&T/SID 7th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1999), pp. 252–256.
  8. J. A. S. Viggiano, “Minimal-knowledge assumptions in digital still camera characterization. I: Uniform distribution, Toeplitz correlation,” in Proceedings of the IS&T/SID 9th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 2001), pp. 332–336.
  9. D. H. Brainard, Colorimetry (McGraw-Hill, New York, 1995), pp. 26.21–26.54.
  10. J. Holm, “Photographic tone and colour reproduction goals,” in Proceedings of the CIE Expert Symposium on Colour Standards for Image Technology (Bureau Central de la CIE, Vienna, 1996), pp. 51–56.
  11. G. W. Larson, H. Rushmeier, and C. Piatko, “A visibility matching tone reproduction operator for high dynamic range scenes,” IEEE Trans. Visualization Comput. Graph. 3, 291–306 (1997).
  12. G. D. Finlayson and M. S. Drew, “The maximum ignorance assumption with positivity,” in Proceedings of the IS&T/SID 4th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1996), pp. 202–204.
  13. D. H. Brainard and W. T. Freeman, “Bayesian color constancy,” J. Opt. Soc. Am. A 14, 1393–1411 (1997).
  14. E. P. Simoncelli, “Bayesian denoising of visual images in the wavelet domain,” in Bayesian Inference in Wavelet Based Models, P. Müller and B. Vidakovic, eds., Vol. 141 of Lecture Notes in Statistics (Springer-Verlag, New York, 1999), pp. 291–308.
  15. Y. Weiss and E. H. Adelson, “Slow and smooth: a Bayesian theory for the combination of local motion signals in human vision,” MIT A.I. Memo 1624, C.B.C.L. Paper 158 (MIT, Cambridge, Mass., 1998).
  16. X. Zhang and D. H. Brainard, “Method and apparatus for estimating true color values for saturated color values in digitally captured image data,” U.S. patent 6,731,794 (May 4, 2004).
  17. T. O. Berger, Statistical Decision Theory and Bayesian Analysis (Springer-Verlag, New York, 1985).
  18. P. M. Lee, Bayesian Statistics (Oxford U. Press, London, 1989).
  19. D. H. Brainard, “Bayesian method for reconstructing color images from trichromatic samples,” in Proceedings of the IS&T 47th Annual Meeting (Society for Imaging Science and Technology, Springfield, Va., 1994), pp. 375–380.
  20. W. R. Dillon and M. Goldstein, Multivariate Analysis (Wiley, New York, 1984).
  21. X. Zhang and D. H. Brainard, “Bayes color correction method for non-colorimetric digital image sensors,” in Proceedings of the IS&T/SID 12th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 2004).
  22. J. E. Adams, Jr. and J. F. Hamilton, Jr., “Adaptive color plane interpolation in single sensor color electronic camera,” U.S. patent 5652621 (July 29, 1997).
  23. H. J. Trussell and R. E. Hartwig, “Mathematics for demosaicing,” IEEE Trans. Image Process. 11, 485–492 (2002).
  24. M. J. Vrhel, R. Gershon, and L. S. Iwan, “Measurement and analysis of object reflectance spectra,” Color Res. Appl. 19, 4–9 (1994).
  25. P. L. Vora, J. E. Farrell, J. D. Tietz, and D. H. Brainard, “Image capture: simulation of sensor responses from hyperspectral images,” IEEE Trans. Image Process. 10, 307–316 (2001).
  26. CIE, “Industrial colour-difference evaluation,” Publication CIE 116–95 (Bureau Central de la CIE, Vienna, 1995).
  27. S. Pattanaik, J. Ferwerda, M. Fairchild, and D. Greenberg, “A multiscale model of adaptation and spatial vision for realistic image display,” in Proceedings of SIGGRAPH’98 (www.siggraph.org, 1998), pp. 287–298.
  28. F. Xiao, J. M. DiCarlo, P. B. Catrysse, and B. A. Wandell, “High dynamic range imaging of natural scenes,” in Final Program and Proceedings of the 10th IS&T/SID Color Imaging Conference: Color Science, Systems and Applications (Society for Imaging Science and Technology, Springfield, Va., 2002), pp. 337–342.
  29. D. Yang and B. Fowler, “A 640×512 CMOS image sensor with ultrawide dynamic range floating-point pixel-level ADC,” IEEE J. Solid-State Circuits 34, 1821–1834 (1999).
  30. S. K. Nayar and T. Mitsunaga, “High dynamic range imaging: spatially varying pixel exposures,” in Proceedings of IEEE CVPR (IEEE Press, Piscataway, N.J., 2000), pp. 1472–1479.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited