OSA's Digital Library

Optics Express

Optics Express

  • Editor: C. Martijn de Sterke
  • Vol. 19, Iss. 9 — Apr. 25, 2011
  • pp: 8444–8457

Fusion of infrared and visual images through region extraction by using multi scale center-surround top-hat transform

Xiangzhi Bai, Fugen Zhou, and Bindang Xue  »View Author Affiliations

Optics Express, Vol. 19, Issue 9, pp. 8444-8457 (2011)

View Full Text Article

Enhanced HTML    Acrobat PDF (1282 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



Fusion of infrared and visual images is an important research area in image analysis. The purpose of infrared and visual image fusion is to combine the image information of the original images into the final fusion result. So, it is crucial to effectively extract the image information of the original images and reasonably combine them into the final fusion image. To achieve this purpose, an algorithm by using multi scale center-surround top-hat transform through region extraction is proposed in this paper. Firstly, multi scale center-surround top-hat transform is discussed and used to extract the multi scale bright and dim image regions of the original images. Secondly, the final extracted image regions for image fusion are constructed from the extracted multi scale bright and dim image regions. Finally, after a base image is calculated from the original images, the final extracted image regions are combined into the base image through a power strategy to form the final fusion result. Because the image information of the original images are well extracted and combined, the proposed algorithm is very effective for image fusion. Comparison experiments have been performed on different image sets, and the results verified the effectiveness of the proposed algorithm.

© 2011 OSA

OCIS Codes
(100.2960) Image processing : Image analysis
(100.5010) Image processing : Pattern recognition
(280.4788) Remote sensing and sensors : Optical sensing and sensors

ToC Category:
Image Processing

Original Manuscript: January 18, 2011
Revised Manuscript: April 12, 2011
Manuscript Accepted: April 14, 2011
Published: April 18, 2011

Virtual Issues
Vol. 6, Iss. 5 Virtual Journal for Biomedical Optics

Xiangzhi Bai, Fugen Zhou, and Bindang Xue, "Fusion of infrared and visual images through region extraction by using multi scale center-surround top-hat transform," Opt. Express 19, 8444-8457 (2011)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. J. Nunez, X. Otazu, O. Fors, A. Prades, V. Pala, and R. Arbiol, “Multiresolution-based image fusion with additive wavelet decomposition,” IEEE Trans. Geosci. Rem. Sens. 37(3), 1204–1211 (1999). [CrossRef]
  2. C. A. Lieber, S. Urayama, N. Rahim, R. Tu, R. Saroufeem, B. Reubner, and S. G. Demos, “Multimodal near infrared spectral imaging as an exploratory tool for dysplastic esophageal lesion identification,” Opt. Express 14(6), 2211–2219 (2006), http://www.opticsinfobase.org/abstract.cfm?URI=oe-14-6-2211 . [CrossRef] [PubMed]
  3. Y. Chen, L. Wang, Z. Sun, Y. Jiang, and G. Zhai, “Fusion of color microscopic images based on bidimensional empirical mode decomposition,” Opt. Express 18(21), 21757–21769 (2010), http://www.opticsinfobase.org/abstract.cfm?URI=oe-18-21-21757 . [CrossRef] [PubMed]
  4. M. Leviner and M. Maltz, “A new multi-spectral feature level image fusion method for human interpretation,” Infrared Phys. Technol. 52(2-3), 79–88 (2009). [CrossRef]
  5. G. Pajares and J. M. de la Cruz, “A wavelet-based image fusion tutorial,” Pattern Recognit. 37(9), 1855–1872 (2004). [CrossRef]
  6. K. Amolins, Y. Zhang, and P. Dare, “Wavelet based image fusion techniques—an introduction, review and comparison,” ISPRS J. Photogramm. Remote Sens. 62(4), 249–263 (2007). [CrossRef]
  7. Q. Guihong, Z. Dali, and Y. Pingfan, “Medical image fusion by wavelet transform modulus maxima,” Opt. Express 9(4), 184–190 (2001), http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-9-4-184 . [CrossRef] [PubMed]
  8. F. Nencini, A. Garzelli, S. Baronti, and L. Alparone, “Remote sensing image fusion using the curvelet transform,” Inf. Fusion 8(2), 143–156 (2007). [CrossRef]
  9. N. Mitianoudis and T. Stathaki, “Pixel-based and region-based image fusion schemes using ICA bases,” Inf. Fusion 8(2), 131–142 (2007). [CrossRef]
  10. M. González-Audícana, J. L. Saleta, R. G. Catalán, and R. García, “Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition,” IEEE Trans. Geosci. Rem. Sens. 42(6), 1291–1299 (2004). [CrossRef]
  11. N. Cvejic, D. Bull, and N. Canagarajah, “Region-based multimodal image fusion using ICA bases,” IEEE Sens. J. 7(5), 743–751 (2007). [CrossRef]
  12. S. Li and B. Yang, “Multifocus image fusion using region segmentation and spatial frequency,” Image Vis. Comput. 26(7), 971–979 (2008). [CrossRef]
  13. A. Toet, M. A. Hogervorst, S. G. Nikolov, J. J. Lewis, T. D. Dixon, D. R. Bull, and C. N. Canagarajah, “Towards cognitive image fusion,” Inf. Fusion 11(2), 95–113 (2010). [CrossRef]
  14. Z. Wang, Y. Ma, and J. Gu, “Multi-focus image fusion using PCNN,” Pattern Recognit. 43(6), 2003–2016 (2010). [CrossRef]
  15. W. Huang and Z. Jing, “Multi-focus image fusion using pulse coupled neural network,” Pattern Recognit. Lett. 28(9), 1123–1132 (2007). [CrossRef]
  16. P. Soille, Morphological Image Analysis-Principle and Applications (Springer, 2003).
  17. X. Bai, F. Zhou, and T. Jin, “Enhancement of dim small target through modified top-hat transformation under the condition of heavy clutter,” Signal Process. 90(5), 1643–1654 (2010). [CrossRef]
  18. X. Bai and F. Zhou, “Analysis of different modified top-hat transformations based on structuring element constructing,” Signal Process. 90(11), 2999–3003 (2010). [CrossRef]
  19. X. Bai and F. Zhou, “Top-hat selection transformation for infrared dim small target enhancement,” Imaging Sci. J. 58(2), 112–117 (2010). [CrossRef]
  20. M. Zeng, J. Li, and Z. Peng, “The design of top-hat morphological filter and application to infrared target detection,” Infrared Phys. Technol. 48(1), 67–76 (2006). [CrossRef]
  21. P. Jackway, “Improved morphological top-hat,” Electron. Lett. 36(14), 1194–1195 (2000). [CrossRef]
  22. S. Mukhopadhyay and B. Chanda, “Fusion of 2D grayscale images using multiscale morphology,” Pattern Recognit. 34(10), 1939–1949 (2001). [CrossRef]
  23. P. Jackway and M. Deriche, “Scale-space properties of the multiscale morphological dilation-erosion,” IEEE Trans. Pattern Anal. Mach. Intell. 18(1), 38–51 (1996). [CrossRef]
  24. M. A. Oliveira and N. J. Leite, “A multiscale directional operator and morphological tools for reconnecting broken ridges in fingerprint images,” Pattern Recognit. 41(1), 367–377 (2008). [CrossRef]
  25. I. De, B. Chanda, and B. Chattopadhyay, “Enhancing effective depth-of-field by image fusion using mathematical morphology,” Image Vis. Comput. 24(12), 1278–1287 (2006). [CrossRef]
  26. X. Bai, F. Zhou, and B. Xue, “Infrared image enhancement through contrast enhancement by using multi scale new top-hat transform,” Infrared Phys. Technol. 54(2), 61–69 (2011). [CrossRef]
  27. X. Bai and F. Zhou, “Analysis of new top-hat transformation and the application for infrared dim small target detection,” Pattern Recognit. 43(6), 2145–2156 (2010). [CrossRef]
  28. J. W. Roberts, J. Van Aardt, and F. Ahmed, “Assessment of image fusion procedures using entropy, image quality, and multispectral classification,” J. Appl. Remote Sens. 2(1), 023522 (2008). [CrossRef]
  29. Y. Chen, Z. Xue, and R. S. Blum, “Theoretical analysis of an information-based quality measure for image fusion,” Inf. Fusion 9(2), 161–175 (2008). [CrossRef]
  30. G. Qu, D. Zhang, and P. Yan, “Information measure for performance of image fusion,” Electron. Lett. 38(7), 313–315 (2002). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited