OSA's Digital Library

Optics Express

Optics Express

  • Editor: Andrew M. Weiner
  • Vol. 21, Iss. 8 — Apr. 22, 2013
  • pp: 9824–9838

Multi-sensor image registration based on algebraic projective invariants

Bin Li, Wei Wang, and Hao Ye  »View Author Affiliations

Optics Express, Vol. 21, Issue 8, pp. 9824-9838 (2013)

View Full Text Article

Enhanced HTML    Acrobat PDF (1607 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



A new automatic feature-based registration algorithm is presented for multi-sensor images with projective deformation. Contours are firstly extracted from both reference and sensed images as basic features in the proposed method. Since it is difficult to design a projective-invariant descriptor from the contour information directly, a new feature named Five Sequential Corners (FSC) is constructed based on the corners detected from the extracted contours. By introducing algebraic projective invariants, we design a descriptor for each FSC that is ensured to be robust against projective deformation. Further, no gray scale related information is required in calculating the descriptor, thus it is also robust against the gray scale discrepancy between the multi-sensor image pairs. Experimental results utilizing real image pairs are presented to show the merits of the proposed registration method.

© 2013 OSA

OCIS Codes
(100.2000) Image processing : Digital image processing
(100.5010) Image processing : Pattern recognition
(100.3008) Image processing : Image recognition, algorithms and filters

ToC Category:
Image Processing

Original Manuscript: January 9, 2013
Revised Manuscript: March 17, 2013
Manuscript Accepted: April 2, 2013
Published: April 12, 2013

Bin Li, Wei Wang, and Hao Ye, "Multi-sensor image registration based on algebraic projective invariants," Opt. Express 21, 9824-9838 (2013)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. B. Zitova and J. Flusser, “Image registration methods: a survey,” Image Vis. Comput.21(11), 977–1000 (2003).
  2. J. J. Arthur, L. J. Kramer, and R. E. Bailey, “Flight test comparison between enhanced vision (FLIR) and synthetic vision systems,” (SPIE-INT SOC Optical Engineering, BELLINGHAM, 2005), pp. 25–36.
  3. R. J. Radke, S. Andra, O. Al-Kofahi, and B. Roysam, “Image change detection algorithms: a systematic survey,” IEEE Trans. Image Process.14(3), 294–307 (2005).
  4. J. P. Pluim, J. B. Maintz, and M. A. Viergever, “Mutual-information-based registration of medical images: a survey,” IEEE Trans. Med. Imaging22(8), 986–1004 (2003).
  5. H. Luan, F. Qi, Z. Xue, L. Chen, and D. Shen, “Multimodality image registration by maximization of quantitative-qualitative measure of mutual information,” Pattern Recognit.41(1), 285–298 (2008).
  6. F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, “Multimodality image registration by maximization of mutual information,” IEEE Trans. Med. Imaging16(2), 187–198 (1997).
  7. A. A. Cole-Rhodes, K. L. Johnson, J. LeMoigne, and I. Zavorin, “Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient,” IEEE Trans. Image Process.12(12), 1495–1511 (2003).
  8. J. P. Heather and M. I. Smith, “Multimodal image registration with applications to image fusion,” 2005 7th International Conference on Information Fusion (FUSION), Vols 1 and 2, 372–379 (2005).
  9. M. Irani and P. Anandan, “Robust multi-sensor image alignment,” Sixth International Conference on Computer Vision, 959–966 (1998).
  10. Z. H. Zhang, C. H. Pan, and S. D. Ma, “An automatic method of coarse registration between multi-source satellite images,” Proceedings of the 2004 Intelligent Sensors, Sensor Networks & Information Processing Conference, 205–209 (2004).
  11. M. A. Ali and D. A. Clausi, “Automatic registration of SAR and visible band remote sensing images,” 2002 IEEE International Geoscience and Remote Sensing Symposium. 24th Canadian Symposium on Remote Sensing. Proceedings (Cat. No.02CH37380), 1331–1333 (2002).
  12. H. Li, B. S. Manjunath, and S. K. Mitra, “A contour-based approach to multisensor image registration,” IEEE Trans. Image Process.4(3), 320–334 (1995).
  13. S. Dawn, V. Saxena, and B. Sharma, “Remote Sensing Image Registration Techniques: A Survey,” Image and Signal Processing. Proceedings 4th International Conference, ICISP 2010, 103–112 (2010).
  14. Z. L. Song and J. P. Zhang, “Remote Sensing Image Registration Based on Retrofitted SURF Algorithm and Trajectories Generated From Lissajous Figures,” IEEE Geosci. Remote Sens. Lett.7(3), 491–495 (2010).
  15. Z. L. Song, S. Li, and T. F. George, “Remote sensing image registration approach based on a retrofitted SIFT algorithm and Lissajous-curve trajectories,” Opt. Express18(2), 513–522 (2010).
  16. N. Alajlan, I. El Rube, M. S. Kamel, and G. Freeman, “Shape retrieval using triangle-area representation and dynamic space warping,” Pattern Recognit.40(7), 1911–1920 (2007).
  17. D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” Int. J. Comput. Vis.60(2), 91–110 (2004).
  18. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, “Speeded-Up Robust Features (SURF),” Comput. Vis. Image Underst.110(3), 346–359 (2008).
  19. J. L. Mundy and A. Zisserman, Geometric Invariance in Computer Vision (the MIT Press, 1992).
  20. J. Canny, “A computational approach to edge detection,” IEEE Trans. Pattern Anal. Mach. Intell.8(6), 679–698 (1986).
  21. F. Mokhtarian and R. Suomela, “Robust image corner detection through curvature scale space,” IEEE Trans. Pattern Anal20(12), 1376–1381 (1998).
  22. X. C. He and N. H. C. Yung, “Corner detector based on global and local curvature properties,” Opt. Eng.47, 057008 (2008).
  23. M. A. Fischler and R. C. Bolles, “Random Sample Consensus - A Paradigm For Model-Fitting With Applications To Image-Analysis And Automated Cartography,” Commun. ACM24, 381–395 (1981).
  24. K. Mikolajczyk and C. Schmid, “Performance evaluation of local descriptors,” IEEE Trans. Pattern Anal. Mach. Intell.27(10), 1615–1630 (2005).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited