OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A


  • Editor: Franco Gori
  • Vol. 30, Iss. 3 — Mar. 1, 2013
  • pp: 353–366

Hierarchy of nonlocal means for preferred automatic sharpness enhancement and tone mapping

Anustup Choudhury and Gérard Medioni  »View Author Affiliations

JOSA A, Vol. 30, Issue 3, pp. 353-366 (2013)

View Full Text Article

Enhanced HTML    Acrobat PDF (3476 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



Existing hierarchical techniques that decompose an image into a smooth image and high frequency components based on Gaussian filter and bilateral filter suffer from halo effects, whereas techniques based on weighted least squares extract low contrast features as details. Other techniques require multiple images and are not tolerant to noise. We use a single image to enhance sharpness based on a hierarchical framework using a modified Laplacian pyramid. In order to ensure robustness, we remove noise by using an extra level in the hierarchical framework. We use an edge-preserving nonlocal means filter and modify it to remove potential halo effects and gradient reversals. However, these effects are only reduced but not removed completely after similar modifications are made to the bilateral filter. We compare our results with existing techniques and show better decomposition and enhancement. Based on validation by human observers, we introduce a new measure to quantify sharpness quality, which allows us to automatically set parameters in order to achieve preferred sharpness enhancement. This causes blurry images to be sharpened more and sufficiently sharp images not to be sharpened. Finally, we demonstrate applications in the context of robust high dynamic range tone mapping that is better than state-of-the-art approaches and enhancement of archaeological artifacts.

© 2013 Optical Society of America

OCIS Codes
(100.0100) Image processing : Image processing
(100.2980) Image processing : Image enhancement

ToC Category:
Image Processing

Original Manuscript: August 23, 2012
Revised Manuscript: October 30, 2012
Manuscript Accepted: November 26, 2012
Published: February 12, 2013

Anustup Choudhury and Gérard Medioni, "Hierarchy of nonlocal means for preferred automatic sharpness enhancement and tone mapping," J. Opt. Soc. Am. A 30, 353-366 (2013)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, “Edge-preserving decompositions for multi-scale tone and detail manipulation,” in ACM SIGGRAPH (ACM, 2008).
  2. A. Buades, B. Coll, and J.-M. Morel, “Nonlocal image and movie denoising,” Int. J. Comput. Vis. 76, 123–139 (2008). [CrossRef]
  3. P. J. Burt and E. H. Adelson, “The Laplacian pyramid as a compact image code,” IEEE Trans. Commun. 31, 532–540 (1983). [CrossRef]
  4. C. Hentschel and D. La Hei, “Effective peaking filter and its implementation on a programmable architecture,” in ICCE (IEEE Computer Society, 1999), pp. 330–331.
  5. P. Lin and Y.-T. Kim, “An adaptive color transient improvement algorithm,” IEEE Trans. Consum. Electron. 49, 1326–1329 (2003). [CrossRef]
  6. C. Hentschel, “Video moire cancellation filter for high-resolution crts,” in ICCE (IEEE Computer Society, 1999), pp. 200–201.
  7. H. Greenspan, C. Anderson, and S. Akber, “Image enhancement by nonlinear extrapolation in frequency space,” IEEE Trans. Image Process. 9, 1035–1048 (2000). [CrossRef]
  8. J. Tumblin and G. Turk, “LCIS: a boundary hierarchy for detail-preserving contrast reduction,” in ACM SIGGRAPH (ACM, 1999), pp. 83–90.
  9. R. Fattal, M. Agrawala, and S. Rusinkiewicz, “Multi scale shape and detail enhancement from multi-light image collections,” in ACM SIGGRAPH (ACM, 2007).
  10. F. Durand and J. Dorsey, “Fast bilateral filtering for the display of high-dynamic-range images,” in ACM SIGGRAPH (ACM, 2002), pp. 257–266.
  11. J. Chen, S. Paris, and F. Durand, “Real-time edge-aware image processing with the bilateral grid,” ACM Trans. Graph. 26(3), 103 (2007). [CrossRef]
  12. S. Bae, S. Paris, and F. Durand, “Two-scale tone management for photographic look,” ACM Trans. Graph. 25, 637–645 (2006). [CrossRef]
  13. M. Kass and J. Solomon, “Smoothed local histogram filters,” ACM Trans. Graph. 29, 1–10 (2010). [CrossRef]
  14. K. Subr, C. Soler, and F. Durand, “Edge-preserving multiscale image decomposition based on local extrema,” in ACM SIGGRAPH Asia (ACM, 2009).
  15. S. Paris, S. W. Hasinoff, and J. Kautz, “Local Laplacian filters: edge-aware image processing with a Laplacian pyramid,” in ACM SIGGRAPH (ACM, 2011).
  16. L. Xu, C. Lu, Y. Xu, and J. Jia, “Image smoothing via L0 gradient minimization,” in SIGGRAPH Asia (ACM, 2011), pp. 1–12.
  17. E. S. L. Gastal and M. M. Oliveira, “Domain transform for edge-aware image and video processing,” ACM Trans. Graph. 30, 1–12 (2011). [CrossRef]
  18. A. Choudhury and G. Medioni, “Perceptually motivated automatic sharpness enhancement using hierarchy of non-local means,” in ICCV 2011—Proceedings of Color and Photometry in Computer Vision Workshop (IEEE Computer Society, 2011), pp. 730–737.
  19. C. Tomasi and R. Manduchi, “Bilateral filtering for gray and color images,” in ICCV-1998, Sixth International Conference on Computer Vision (IEEE Computer Society, 1998), pp. 839–846.
  20. P. Perona and J. Malik, “Scale-space and edge detection using anisotropic diffusion,” IEEE Trans. Pattern Anal. Mach. Intell. 12, 629–639 (1990). [CrossRef]
  21. B. Zhang and J. Allebach, “Adaptive bilateral filter for sharpness enhancement and noise removal,” IEEE Trans. Image Process. 17, 664–678 (2008). [CrossRef]
  22. R. Fattal, “Edge-avoiding wavelets and their applications,” ACM Trans. Graph. 28, 1–10 (2009). [CrossRef]
  23. D. J. Jobson, Z. Rahman, and G. A. Woodell, “A multiscale retinex for bridging the gap between color images and the human observation of scenes,” IEEE Trans. Image Process. 6, 965–976 (1997). [CrossRef]
  24. S. N. Pattanaik, J. A. Ferwerda, M. D. Fairchild, and D. P. Greenberg, “A multiscale model of adaptation and spatial vision for realistic image display,” in ACM SIGGRAPH (ACM, 1998), pp. 287–298.
  25. Y. Li, L. Sharan, and E. H. Adelson, “Compressing and companding high dynamic range images with subband architectures,” in ACM SIGGRAPH (ACM, 2005), pp. 836–844.
  26. R. Fattal, D. Lischinski, and M. Werman, “Gradient domain high dynamic range compression,” in ACM SIGGRAPH (ACM, 2002), pp. 249–256.
  27. E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, “Photographic tone reproduction for digital images,” ACM Trans. Graph. 21, 267–276 (2002). [CrossRef]
  28. R. C. Bilcu and M. Vehvilainen, “Constrained unsharp masking for image enhancement,” in International Conference on Image and Signal Processing (Springer-Verlag, 2008), pp. 10–19.
  29. Y.-L. Liu, J. Wang, X. Chen, Y.-W. Guo, and Q.-S. Peng, “A robust and fast non-local means algorithm for image denoising,” J. Comput. Sci. Tech. 23, 270–279 (2008). [CrossRef]
  30. D. Comaniciu and P. Meer, “Mean shift: a robust approach toward feature space analysis,” IEEE Trans. Pattern Anal. Mach. Intell. 24603–619 (2002). [CrossRef]
  31. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Trans. Image Process. 13, 600–612 (2004). [CrossRef]
  32. P. Choudhury and J. Tumblin, “Trilateral filter for high contrast images and meshes,” in ACM SIGGRAPH (ACM, 2005).
  33. E. P. Krotkov, Active Computer Vision by Cooperative Focus and Stereo (Springer-Verlag, 1989).
  34. J. M. Tenenbaum, “Accommodation in computer vision,” Ph.D. thesis (Stanford, 1971).
  35. Z. Chen, B. Abidi, D. Page, and M. Abidi, “Gray-level grouping (GLG): an automatic method for optimized image contrast enhancement—part I: the basic method,” IEEE Trans. Image Process. 15, 2290–2302 (2006). [CrossRef]
  36. D. Shaked and I. Tastl, “Sharpness measure: towards automatic image enhancement,” in ICIP--International Conference on Image Processing (IEEE, 2005).
  37. J. Caviedes and S. Gurbuz, “No-reference sharpness metric based on local edge kurtosis” in ICIP--International Conference on Image Processing (IEEE, 2002).
  38. B. Zhang, J. P. Allebach, and Z. Pizlo, “An investigation of perceived sharpness and sharpness metrics,” Proc. SPIE 5668, pp. 98–1102005).
  39. F. Wilcoxon, “Individual comparisons by ranking methods,” Biom. Bull. 1, 80–83 (1945). [CrossRef]
  40. E. Peli, J. Kim, Y. Yitzhaky, R. B. Goldstein, and R. L. Woods, “Wideband enhancement of television images for people with visual impairments,” J. Opt. Soc. Am. 21, 937–950 (2004). [CrossRef]
  41. J. A. Hanley and B. J. McNeil, “The meaning and use of the area under a receiver operating characteristic (ROC) curve,” Radiology 143, 29–36 (1982).
  42. T. Malzbender, D. Gelb, and H. Wolters, “Polynomial texture maps,” in ACM SIGGRAPH (ACM, 2001).
  43. M. Kolomenkin, I. Shimshoni, and A. Tal, “Prominent field for shape analysis of archaeological artifacts,” in CCV 2009—IEEE 12th International Conference on Computer Vision: Workshops on eHeritage & Digital Art Preservation (IEEE, 2009), pp. 915–923.
  44. A. Kharlamov and V. Podlozhnyuk, “Image denoising,” NVIDIA Technical Report (NVIDIA, 2007).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited