OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 21, Iss. 12 — Dec. 1, 2004
  • pp: 2301–2310

Estimation of saturated pixel values in digital color imaging

Xuemei Zhang and David H. Brainard  »View Author Affiliations


JOSA A, Vol. 21, Issue 12, pp. 2301-2310 (2004)
http://dx.doi.org/10.1364/JOSAA.21.002301


View Full Text Article

Enhanced HTML    Acrobat PDF (313 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Pixel saturation, in which the incident light at a pixel causes one of the color channels of the camera sensor to respond at its maximum value, can produce undesirable artifacts in digital color images. We present a Bayesian algorithm that estimates what the saturated channel’s value would have been in the absence of saturation. The algorithm uses the nonsaturated responses from the other color channels, together with a multivariate normal prior that captures the correlation in response across color channels. The prior may be estimated directly from the image data, since most image pixels are not saturated. Given the prior and the responses of the nonsaturated channels, the algorithm returns the optimal expected mean square estimate for the true response. Extensions of the algorithm to the case in which more than one channel is saturated are also discussed. Both simulations and examples with real images are presented to show that the algorithm is effective.

© 2004 Optical Society of America

OCIS Codes
(100.2000) Image processing : Digital image processing
(100.3010) Image processing : Image reconstruction techniques
(330.1690) Vision, color, and visual optics : Color

History
Original Manuscript: May 18, 2004
Revised Manuscript: July 21, 2004
Manuscript Accepted: July 21, 2004
Published: December 1, 2004

Citation
Xuemei Zhang and David H. Brainard, "Estimation of saturated pixel values in digital color imaging," J. Opt. Soc. Am. A 21, 2301-2310 (2004)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-21-12-2301


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. P. Longere, D. H. Brainard, “Simulation of digital camera images from hyperspectral input,” in Vision Models and Applications to Image and Video Processing, C. van den Branden Lambrecht, ed. (Kluwer Academic, Boston, Mass., 2001), pp. 123–150.
  2. J. Holm, I. Tastl, L. Hanlon, P. Hubel, “Color processing for digital photography,” in Colour Engineering: Achieving Device Independent Colour, P. Green, L. MacDonald, eds. (Wiley, New York, 2002), pp. 179–217.
  3. J. Holm, “A strategy for pictorial digital image processing,” in Proceedings of the IS&T/SID 4th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1996), pp. 194–201.
  4. R. Kimmel, “Demosaicing: image reconstruction from color CCD samples,” IEEE Trans. Image Process. 8, 1221–1228 (1999). [CrossRef]
  5. R. Kakarala, Z. Baharav, “Adaptive demosaicing with the principal vector method,” IEEE Trans. Consum. Electron. 48, 932–937 (2002). [CrossRef]
  6. D. H. Brainard, D. Sherman, “Reconstructing images from trichromatic samples: from basic research to practical applications,” in Proceedings of the 3rd IS&T/SID Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1995), pp. 4–10.
  7. B. Tao, I. Tastl, T. Cooper, M. Blasgen, E. Edwards, “Demosaicing using human visual properties and wavelet interpolation filtering,” in Proceedings of the IS&T/SID 7th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1999), pp. 252–256.
  8. J. A. S. Viggiano, “Minimal-knowledge assumptions in digital still camera characterization. I: Uniform distribution, Toeplitz correlation,” in Proceedings of the IS&T/SID 9th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 2001), pp. 332–336.
  9. D. H. Brainard, Colorimetry (McGraw-Hill, New York, 1995), pp. 26.21–26.54.
  10. J. Holm, “Photographic tone and colour reproduction goals,” in Proceedings of the CIE Expert Symposium on Colour Standards for Image Technology (Bureau Central de la CIE, Vienna, 1996), pp. 51–56.
  11. G. W. Larson, H. Rushmeier, C. Piatko, “A visibility matching tone reproduction operator for high dynamic range scenes,” IEEE Trans. Visualization Comput. Graph. 3, 291–306 (1997). [CrossRef]
  12. G. D. Finlayson, M. S. Drew, “The maximum ignorance assumption with positivity,” in Proceedings of the IS&T/SID 4th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 1996), pp. 202–204.
  13. D. H. Brainard, W. T. Freeman, “Bayesian color constancy,” J. Opt. Soc. Am. A 14, 1393–1411 (1997). [CrossRef]
  14. E. P. Simoncelli, “Bayesian denoising of visual images in the wavelet domain,” in Bayesian Inference in Wavelet Based Models, P. Müller, B. Vidakovic, eds., Vol. 141 of Lecture Notes in Statistics (Springer-Verlag, New York, 1999), pp. 291–308. [CrossRef]
  15. Y. Weiss, E. H. Adelson, “Slow and smooth: a Bayesian theory for the combination of local motion signals in human vision,” (MIT, Cambridge, Mass., 1998).
  16. X. Zhang, D. H. Brainard, “Method and apparatus for estimating true color values for saturated color values in digitally captured image data,” U.S. patent6,731,794 (May4, 2004).
  17. T. O. Berger, Statistical Decision Theory and Bayesian Analysis (Springer-Verlag, New York, 1985).
  18. P. M. Lee, Bayesian Statistics (Oxford U. Press, London, 1989).
  19. D. H. Brainard, “Bayesian method for reconstructing color images from trichromatic samples,” in Proceedings of the IS&T 47th Annual Meeting (Society for Imaging Science and Technology, Springfield, Va., 1994), pp. 375–380.
  20. W. R. Dillon, M. Goldstein, Multivariate Analysis (Wiley, New York, 1984).
  21. X. Zhang, D. H. Brainard, “Bayes color correction method for non-colorimetric digital image sensors,” in Proceedings of the IS&T/SID 12th Color Imaging Conference (Society for Imaging Science and Technology, Springfield, Va., 2004).
  22. J. E. Adams, J. F. Hamilton, “Adaptive color plane interpolation in single sensor color electronic camera,” U.S. patent5652621 (July29, 1997).
  23. H. J. Trussell, R. E. Hartwig, “Mathematics for demosaicing,” IEEE Trans. Image Process. 11, 485–492 (2002). [CrossRef]
  24. M. J. Vrhel, R. Gershon, L. S. Iwan, “Measurement and analysis of object reflectance spectra,” Color Res. Appl. 19, 4–9 (1994).
  25. P. L. Vora, J. E. Farrell, J. D. Tietz, D. H. Brainard, “Image capture: simulation of sensor responses from hyperspectral images,” IEEE Trans. Image Process. 10, 307–316 (2001). [CrossRef]
  26. CIE, “Industrial colour-difference evaluation,” (Bureau Central de la CIE, Vienna, 1995).
  27. S. Pattanaik, J. Ferwerda, M. Fairchild, D. Greenberg, “A multiscale model of adaptation and spatial vision for realistic image display,” in Proceedings of SIGGRAPH’98 ( www.siggraph.org , 1998), pp. 287–298.
  28. F. Xiao, J. M. DiCarlo, P. B. Catrysse, B. A. Wandell, “High dynamic range imaging of natural scenes,” in Final Program and Proceedings of the 10th IS&T/SID Color Imaging Conference: Color Science, Systems and Applications (Society for Imaging Science and Technology, Springfield, Va., 2002), pp. 337–342.
  29. D. Yang, B. Fowler, “A 640×512 CMOS image sensor with ultrawide dynamic range floating-point pixel-level ADC,” IEEE J. Solid-State Circuits 34, 1821–1834 (1999). [CrossRef]
  30. S. K. Nayar, T. Mitsunaga, “High dynamic range imaging: spatially varying pixel exposures,” in Proceedings of IEEE CVPR (IEEE Press, Piscataway, N.J., 2000), pp. 1472–1479.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Figures

Fig. 1 Fig. 2 Fig. 3
 
Fig. 4 Fig. 5
 

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited