OSA's Digital Library

Applied Optics

Applied Optics


  • Editor: Joseph N. Mait
  • Vol. 48, Iss. 21 — Jul. 20, 2009
  • pp: 4201–4212

Infrared human tracking with improved mean shift algorithm based on multicue fusion

Xin Wang, Lei Liu, and Zhenmin Tang  »View Author Affiliations

Applied Optics, Vol. 48, Issue 21, pp. 4201-4212 (2009)

View Full Text Article

Enhanced HTML    Acrobat PDF (1570 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



Mean shift has been presented as a well known and efficient algorithm for tracking infrared targets. However, under complex backgrounds, such as clutter, varying illumination, and occlusion, the traditional mean tracking method often converges to a local maximum and loses the real infrared target. To cope with these problems, an improved mean shift tracking algorithm based on multicue fusion is proposed. According to the characteristics of the human in infrared images, the algorithm first extracts the gray and edge cues, and then uses the motion information to guide the two cues to obtain improved motion-guided gray and edge cues that are fused adaptively into the mean shift framework. Finally an automatic model update is used to improve the tracking performance further. The experimental results show that, compared with the traditional mean shift algorithm, the presented method greatly improves the accuracy and effectiveness of infrared human tracking under complex scenes, and the tracking results are satisfactory.

© 2009 Optical Society of America

OCIS Codes
(040.1880) Detectors : Detection
(040.3060) Detectors : Infrared
(100.2000) Image processing : Digital image processing
(100.4999) Image processing : Pattern recognition, target tracking

ToC Category:

Original Manuscript: March 30, 2009
Revised Manuscript: June 4, 2009
Manuscript Accepted: June 29, 2009
Published: July 15, 2009

Virtual Issues
Vol. 4, Iss. 9 Virtual Journal for Biomedical Optics

Xin Wang, Lei Liu, and Zhenmin Tang, "Infrared human tracking with improved mean shift algorithm based on multicue fusion," Appl. Opt. 48, 4201-4212 (2009)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. M. Yasuno, S. Ryousuke, N. Yasuda, and M. Aoki, “Pedestrian detection and tracking in far infrared images,” in IEEE Conference on Intelligent Transportation Systems, 2005 (IEEE, 2005), pp. 182-187.
  2. R. M. Liu, E. Q. Liu, J. Yang, Y. Zeng, F. L. Wang, and Y. Cao, “Automatically detect and track infrared small targets with kernel Fukunaga--Koontz transform and Kalman prediction,” Appl. Opt. 46, 7780-7791 (2007). [CrossRef] [PubMed]
  3. K. Brunnstrom, B. N. Schenkman, and B. Jacobson, “Object detection in cluttered infrared images,” Opt. Eng. 42, 388-399 (2003). [CrossRef]
  4. A. Bal and M. S. Alam, “Dynamic target tracking with fringe-adjusted joint transform correlation and template matching,” Appl. Opt. 43, 4874-4881 (2004). [CrossRef] [PubMed]
  5. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, “A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking,” IEEE Trans. Signal Process. 50, 174-188 (2002). [CrossRef]
  6. K. Nummiaro, E. Koller-Meier, and L. V. Gool, “An adaptive color-based particle filter,” Image Vision Comput. 21, 99-110(2003). [CrossRef]
  7. M. Isard and A. Blake, “CONDENSATION: conditional density propagation for visual tracking,” Int. J. Comput. Vision 29, 5-28 (1998). [CrossRef]
  8. H. T. Hu, Z. L. Jing, and S. Q. Hu, “Track before detect for point targets with particle filter in infrared image sequences,” Chin. Opt. Lett. 3, 322-325 (2005).
  9. D. Comaniciu, V. Ramesh, and P. Meer, “Real-time tracking of non-rigid objects using mean shift,” in IEEE Conference on Computer Vision and Pattern Recognition, 2000 (IEEE, 2000), pp. 142-149.
  10. C. Yang, R. Duraiswami, and L. Davis, “Efficient mean-shift tracking via a new similarity measure,” in IEEE Conference on Computer Vision and Pattern Recognition, 2005 (IEEE, 2005), pp. 176-183.
  11. D. Comaniciu and V. Ramesh, “Mean shift and optimal prediction for efficient object tracking,” in IEEE Conference on Image Processing, 2000 (IEEE, 2000), pp. 70-73.
  12. K. Fukunaga and L. Hostetler, “The estimation of the gradient of a density function, with applications in pattern recognition,” IEEE Trans. Inf. Theory 21, 32-40 (1975). [CrossRef]
  13. Y. Cheng, “Mean shift, mode seeking, and clustering,” IEEE Trans. Pattern Anal. Mach. Intell. 17, 790-799 (1995). [CrossRef]
  14. D. Comaniciu, V. Ramesh, and P. Meer, “Kernel-based object tracking,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 564-577 (2003). [CrossRef]
  15. D. Comaniciu and P. Meer, “Mean shift: a robust approach toward feature space analysis,” IEEE Trans. Pattern Anal. Mach. Intell. 24, 603-619 (2002). [CrossRef]
  16. J. G. Ling, E. Q. Liu, H. Y. Liang, and J. Yang, “Infrared target tracking with kernel-based performance metric and eigenvalue-based similarity measure,” Appl. Opt. 46, 3239-3252(2007). [CrossRef] [PubMed]
  17. C. F. Shana, T. N. Tan, and Y. C. Wei, “Real-time hand tracking using a mean shift embedded particle filter,” Pattern Recogn. 40, 1958-1970 (2007). [CrossRef]
  18. J. Jeyakar, R. V. Babu, and K. R. Ramakrishnan, “Robust object tracking with background-weighted local kernels,” Comput. Vision Image Underst. 112, 296-309 (2008). [CrossRef]
  19. R. V. Babu, P. Perez, and P. Bouthemy, “Robust tracking with motion estimation and local kernel-based color modeling,” Image Vision Comput. 25, 1205-1216 (2007). [CrossRef]
  20. H. Liu, Z. Yu, H. B. Zha, Y. X. Zou, and L. Zhang, “Robust human tracking based on multi-cue integration and mean-shift,” Pattern Recogn. Lett. (to be published). [CrossRef]
  21. P. Brasnett, L. Mihaylova, D. Bull, and N. Canagarajah, “Sequential Monte Carlo tracking by fusing multiple cues in video sequences,” Image Vision Comput. 25, 1217-1227(2007). [CrossRef]
  22. D. Borghys, P. Verlinde, C. Perneel, and M. Acheroy, “Multilevel data fusion for the detection of targets using multispectral image sequences,” Opt. Eng. 37, 477-484 (1998). [CrossRef]
  23. J. S. Hu, C. W. Juan, and J. J Wang, “A spatial-color mean-shift object tracking algorithm with scale and orientation estimation,” Pattern Recogn. Lett. 29, 2165-2173 (2008). [CrossRef]
  24. F. Aherne, N. Thacker, and P. Rockett, “The Bhattacharyya metric as an absolute similarity measure for frequency coded data,” Kybernetika 34, 363-368 (1997).
  25. J. W. Davis, “OTCBVS benchmark dataset collection,” http://www.cse.ohio-state.edu/otcbvs-bench/.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited