OSA's Digital Library

Virtual Journal for Biomedical Optics

Virtual Journal for Biomedical Optics

| EXPLORING THE INTERFACE OF LIGHT AND BIOMEDICINE

  • Editor: Gregory W. Faris
  • Vol. 2, Iss. 10 — Oct. 31, 2007

Model of retinal local adaptation for the tone mapping of color filter array images

Laurence Meylan, David Alleysson, and Sabine Süsstrunk  »View Author Affiliations


JOSA A, Vol. 24, Issue 9, pp. 2807-2816 (2007)
http://dx.doi.org/10.1364/JOSAA.24.002807


View Full Text Article

Enhanced HTML    Acrobat PDF (1061 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We present a tone mapping algorithm that is derived from a model of retinal processing. Our approach has two major improvements over existing methods. First, tone mapping is applied directly on the mosaic image captured by the sensor, analogous to the human visual system that applies a nonlinearity to the chromatic responses captured by the cone mosaic. This reduces the number of necessary operations by a factor 3. Second, we introduce a variation of the center/surround class of local tone mapping algorithms, which are known to increase the local contrast of images but tend to create artifacts. Our method gives a good improvement in contrast while avoiding halos and maintaining good global appearance. Like traditional center/surround algorithms, our method uses a weighted average of surrounding pixel values. Instead of being used directly, the weighted average serves as a variable in the Naka–Rushton equation, which models the photoreceptors’ nonlinearity. Our algorithm provides pleasing results on various images with different scene content and dynamic range.

© 2007 Optical Society of America

OCIS Codes
(100.2000) Image processing : Digital image processing
(100.2980) Image processing : Image enhancement
(110.5200) Imaging systems : Photography
(330.1690) Vision, color, and visual optics : Color
(330.4060) Vision, color, and visual optics : Vision modeling
(330.6110) Vision, color, and visual optics : Spatial filtering

ToC Category:
Image Processing

History
Original Manuscript: January 24, 2007
Revised Manuscript: April 20, 2007
Manuscript Accepted: April 23, 2007
Published: August 8, 2007

Virtual Issues
Vol. 2, Iss. 10 Virtual Journal for Biomedical Optics

Citation
Laurence Meylan, David Alleysson, and Sabine Süsstrunk, "Model of retinal local adaptation for the tone mapping of color filter array images," J. Opt. Soc. Am. A 24, 2807-2816 (2007)
http://www.opticsinfobase.org/vjbo/abstract.cfm?URI=josaa-24-9-2807


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. A. Roorda, A. B. Mehta, P. Lennie, and D. R. Williams, "Packing arrangement of the three cone classes in primate retina," Vision Res. 41, 1291-1306 (2001). [CrossRef] [PubMed]
  2. J. Holm, I. Tastl, L. Hanlon, and P. Hubel, "Color processing for digital photography," in Colour Engineering: Achieving Device Independent Colour, P.Green and L.MacDonald eds. (Wiley, 2002), pp. 179-220.
  3. C. R. Ingling and E. Martinez-Uriegas, "The spatiotemporal properties of the r-g x-cell channel," Vision Res. 25, 33-38 (1985). [CrossRef] [PubMed]
  4. R. L. De Valois and K. K. De Valois, Spatial Vision, Oxford Psychology Series 14, (Oxford U. Press, 1990).
  5. N. V. S. Graham, Visual Pattern Analysers, Oxford Psychology Series 16 (Oxford U. Press, 1989). [CrossRef]
  6. K.-I. Naka and W. A. H. Rushton, "S-potentials from luminosity units in the retina of fish (Cyprinidae)," J. Physiol. (London) 185, 587-599 (1966).
  7. D. C. Hood, "Lower-level visual processing and models of light adaptation," Annu. Rev. Psychol. 49, 503-535 (1998). [CrossRef] [PubMed]
  8. G. J. Braun and M. D. Fairchild, "Image lightness rescaling using sigmoidal contrast enhancement functions," J. Electron. Imaging 8, 380-393 (1999). [CrossRef]
  9. J. Holm, "Photographic tone and colour reproduction goals," in Proceedings of CIE Expert Symposium'96 on Colour Standards for Image Technology, (CIE, 1996), pp. 51-56.
  10. R. Shapley and C. Enroth-Cugell, "Visual adaptation and retinal gain controls," in Progress in Retinal Research (Pergamon, 1984), pp. 263-346. [CrossRef]
  11. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, 1st ed. (Addison-Wesley, 1993).
  12. W. K. Pratt, Digital Image Processing (Wiley, 1991).
  13. A. Roorda and D. R. Williams, "The arrangement of the three cone classes in the living human eye," Nature 397, 520-522 (1999). [CrossRef] [PubMed]
  14. B. E. Bayer, "Color imaging array," U.S. patent 3,971,065 (March 3, 1976).
  15. J. H. Van Hateren, "Encoding of high dynamic range video with a model of human cones," ACM Trans. Graphics 25, 1380-1399 (2006). [CrossRef]
  16. See http://www.webvision.med.utah.edu/.
  17. M. Kamermans and H. Spekreijse, "The feedback pathway from horizontal cells to cones. A mini review with a look ahead," Vision Res. 39, 2449-2468 (1999). [CrossRef] [PubMed]
  18. M. A. Webster and J. Mollon, "Changes in colour appearance following post-receptoral adaptation," Nature (London) 349, 235-238 (1991). [CrossRef]
  19. T. Yeh, J. Pokorny, and V. C. Smith, "Chromatic discrimination with variation in chromaticity and luminance: data and theory," Vision Res. 33, 1835-1845 (1993). [CrossRef] [PubMed]
  20. H. Spitzer and S. Semo, "Color constancy: a biological model and its application for still and video images," Pattern Recogn. 35, 1645-1659 (2002). [CrossRef]
  21. D. Alleysson, S. Süsstrunk, and J. Herault, "Linear demosaicing inspired by the human visual system," IEEE Trans. Image Process. 14, 439-449 (2005). [CrossRef] [PubMed]
  22. E. Dubois, "Frequency-domain methods for demosaicing of Bayer-sampled color images," IEEE Signal Process. Lett. 12, 847-850 (2005). [CrossRef]
  23. N. Lian, L. Chang, and Y. Tan, "Improved color filter array demosaicing by accurate luminance estimation," in Proceedings of IEEE Conference on Image Processing (IEEE, 2005), pp. I-41-44.
  24. E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, "Photographic tone reproduction for digital images," in Proceedings of ACM SIGGRAPH 2002, Annual Conference on Computer Graphics (ACM, 2002), pp. 267-276.
  25. G. Ward, H. Rushmeier, and C. Piatko, "A visibility matching tone reproduction operator for high dynamic range scenes," IEEE Trans. Vis. Comput. Graph. 3, 291-306 (1997). [CrossRef]
  26. K. Devlin, "A review of tone reproduction techniques," Technical Rep. CSTR-02-005 (Department of Computer Science, University of Bristol, 2002).
  27. E. Reinhard, G. Ward, S. Pattanaik, and P. Debevec, High Dynamic Range Imaging. Acquisition, Display, and Image-Based Lighting, (Morgan Kaufmann, 2005).
  28. M. Ashikhmin, "A tone mapping algorithm for high contrast images," in Proceedings of Eurographics Workshop on Rendering Techniques (Eurographics Association, 2002), pp. 145-155.
  29. L. Meylan and S. Süsstrunk, "High dynamic range image rendering with a Retinex-based adaptive filter," IEEE Trans. Image Process. 15, 2820-2830 (2006). [CrossRef] [PubMed]
  30. Z.-U. Rahman, D. J. Jobson, and G. A. Woodell, "Retinex processing for automatic image enhancement," J. Electron. Imaging 13, 100-110 (2004). [CrossRef]
  31. R. Fattal, D. Lischinski, and M. Werman, "Gradient domain high dynamic range compression," in Proceedings of ACM SIGGRAPH 2002, Annual Conference on Computer Graphics (ACM, 2002), pp. 249-256.
  32. F. Durand and J. Dorsey, "Fast bilateral filtering for the display of high-dynamic-range images," in Proceedings of ACM SIGGRAPH 2002, Annual Conference on Computer Graphics (ACM, 2002), pp. 257-266.
  33. K. Barnard and B. Funt, "Investigations into multi-scale Retinex," in Colour Imaging: Vision and Technology, (Wiley, 1999), pp. 9-17.
  34. K. T. Mullen, "The contrast sensitivity of human colour vision to red/green and blue/yellow chromatic gratings," J. Physiol. (London) 359, 381-400 (1985).
  35. D. Coffin, http://cybercom.net/~dcoffin/dcraw/.
  36. IEC, "Multimedia systems and equipment--colour measurement and management--Part2-1:colour management--default RGB colour space--sRGB," IEC61966-2-1 (IEC, 1999).
  37. Truview Imaging Company, http://truview.com.
  38. P. Ledda, A. Chalmers, T. Troscianko, and H. Seetzen, "Evaluation of tone mapping operators using a high dynamic range display," in Proceedings of ACM SIGGRAPH 2005, Annual Conference on Computer Graphics (ACM, 2005), pp. 640-648.
  39. J. Kuang, H. Yamaguchi, G. M. Johnson, and M. D. Fairchild, "Testing HDR image rendering algorithms," in Proceedings of IS&T/SID Twelfth Color Imaging Conference: Color Science, Systems, and Application, (IS&T, 2004), pp. 315-320.
  40. D. Alleysson, L. Meylan and S. Süsstrunk, "HDR CFA image rendering," in Proceedings of EURASIP 14th European Signal Processing Conference (European Association for Signal Processing, 2006).
  41. Supplementary material available at http://ivrg.epfl.ch/supplementarylowbarmaterial/index.html.
  42. M. Schwab, M. Karrenbach, and J. Claerbout, "Making scientific computations reproducible," Comput. Sci. Eng. 2, 61-67 (2000). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited