OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Editor: Stephen A. Burns
  • Vol. 24, Iss. 8 — Aug. 1, 2007
  • pp: 2109–2121

Estimation of contour motion and deformation for nonrigid object tracking

Jie Shao, Fatih Porikli, and Rama Chellappa  »View Author Affiliations


JOSA A, Vol. 24, Issue 8, pp. 2109-2121 (2007)
http://dx.doi.org/10.1364/JOSAA.24.002109


View Full Text Article

Enhanced HTML    Acrobat PDF (1326 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We present an algorithm for nonrigid contour tracking in heavily cluttered background scenes. Based on the properties of nonrigid contour movements, a sequential framework for estimating contour motion and deformation is proposed. We solve the nonrigid contour tracking problem by decomposing it into three subproblems: motion estimation, deformation estimation, and shape regulation. First, we employ a particle filter to estimate the global motion parameters of the affine transform between successive frames. Then we generate a probabilistic deformation map to deform the contour. To improve robustness, multiple cues are used for deformation probability estimation. Finally, we use a shape prior model to constrain the deformed contour. This enables us to retrieve the occluded parts of the contours and accurately track them while allowing shape changes specific to the given object types. Our experiments show that the proposed algorithm significantly improves the tracker performance.

© 2007 Optical Society of America

OCIS Codes
(330.4150) Vision, color, and visual optics : Motion detection
(330.7310) Vision, color, and visual optics : Vision

ToC Category:
Vision, Color, and Visual Optics

History
Original Manuscript: September 8, 2006
Revised Manuscript: January 3, 2007
Manuscript Accepted: January 11, 2007
Published: July 11, 2007

Virtual Issues
Vol. 2, Iss. 9 Virtual Journal for Biomedical Optics

Citation
Jie Shao, Fatih Porikli, and Rama Chellappa, "Estimation of contour motion and deformation for nonrigid object tracking," J. Opt. Soc. Am. A 24, 2109-2121 (2007)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-24-8-2109


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. M. Isard and A. Blake, "CONDENSATION: conditional density propagation for visual tracking," Int. J. Comput. Vis. 29, 5-28 (1998). [CrossRef]
  2. P. Li, T. Zhang, and A. E. C. Pece, "Visual contour tracking based on particle filters," Image Vis. Comput. 21, 111-123 (2003). [CrossRef]
  3. M. Kass, A. Witkins, and D. Terzopoulos, "Snakes: active contour models," Int. J. Comput. Vis. 1, 321-331 (1988). [CrossRef]
  4. F. Leymarie and M. D. Levine, "Tracking deformable objects in the plane using an active contour model," IEEE Trans. Pattern Anal. Mach. Intell. 15, 617-634 (1993). [CrossRef]
  5. K. P. Nikos and D. Rachid, "A PDE-based level-set approach for detection and tracking of moving objects," in Proceedings of the International Conference on Computer Vision, (IEEE Computer Society, 1998), p. 1139.
  6. M. Rousson and N. Paragios, "Shape priors for level set representations," in Proceedings of the European Conference on Computer Vision 2002 (Springer, 2002), pp. 78-92.
  7. G. Sapiro, Geometric Partial Differential Equations and Image Analysis (Cambridge U. Press, 2001). [CrossRef]
  8. A. Yilmaz, X. Li, and M. Shah, "Contour-based object tracking with occlusion handling in video acquired using mobile cameras," IEEE Trans. Pattern Anal. Mach. Intell. 26, 1531-1536 (2004). [CrossRef] [PubMed]
  9. J. Jackson, A. J. Yezzi, and S. Soatto, "Tracking deformable moving objects under severe occlusions," in Proceedings of the IEEE Conference on Decision and Control (IEEE, 2004), pp. 2990-2995.
  10. Y. Rathi, N. Vaswani, A. Tannenbaum, and A. Yezzi, "Particle filtering for geometric active contours with application to tracking moving and deforming objects," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE Computer Society, 2005), Vol. 2, pp. 2-9.
  11. A. Yezzi and S. Soatto, "Deformation: deforming motion, shape average and the joint registration and approximation of structures in images," Int. J. Comput. Vis. 53, 153-167 (2003). [CrossRef]
  12. J. Foley, A. van Dam, S. Feiner, and J. Hughes, Computer Graphics Principles and Practice, (Addison-Wesley, 1990), Chap. 13, pp. 563-604.
  13. R. E. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME 82 Ser. D, 35-45 (1960).
  14. A. Doucet and N. de Freitas, Sequential Monte Carlo Methods in Practice (Springer-Verlag, 2001).
  15. A. C. Sankaranarayanan, R. Chellappa, and A. Srivastava, "Algorithmic and architectural design methodology for particle filters in hardware," in Proceedings of the International Conference of Computer Design (ICCD) (2005), pp. 275-280.
  16. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process. 50, 174-188 (2002). [CrossRef]
  17. N. J. Gordon, D. J. Salmond, and A. Smith, "Novel approach to nonlinear/non-Gaussian Bayesian state estimation," IEEE Proc. Radar Signal Process. 140, 107-113 (1993). [CrossRef]
  18. S. Zhou, R. Chellappa, and B. Moghaddam, "Visual tracking and recognition using appearance-adaptive models in particle filters," IEEE Trans. Image Process. 13, 1491-1506 (2004). [CrossRef] [PubMed]
  19. D. Metaxas and D. Terzopouilos, "Shape and nonrigid motion estimation through physics-based synthesis," IEEE Trans. Pattern Anal. Mach. Intell. 15, 580-591 (1993). [CrossRef]
  20. G. Xu, E. Segawa, and S. Tsuji, "A robust active contour model with insensitive parameters," in Proceedings of the International Conference on Computer Vision (1993), pp. 562-566.
  21. P. J. Phillips, S. Sarkar, I. Robledo, P. Grother, and K. W. Bowyer, "The gait identification challenge problem: data sets and baseline algorithm," in Proceedings of the International Conference on Pattern Recognition (International Association for Pattern Recognition, 2002), Vol. 1, pp. 385-388.
  22. A. Jain, Fundamentals of Digital Image Processing (Prentice Hall, 1989), Chap. 9.
  23. P. Viola, M. J. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," in Proceedings of the 9th IEEE International Conference on Computer Vision (IEEE Computer Society, 2003), Vol. 2, pp. 734-741. [CrossRef]
  24. K. Toyama and G. Hager, "Incremental focus of attention for robust vision-based tracking," Int. J. Comput. Vis. 35, 45-63 (Jan 1999). [CrossRef]
  25. H. Sidenbladh, M. J. Black, and D. J. Fleet, "Stochastic tracking of 3D human figures using 2D image motion," in Proceedings of the European Conference on Computer Vision 2000 (Springer, 2000), Vol. 2, pp. 702-718.
  26. J. M. Odobez and D. Gatica-Perez, "Embedding motion in model-based stochastic tracking," in Proceedings of the International Conference on Pattern Recognition 2004 (International Society for Pattern Recognition, 2004), Vol. 2, pp. 815-818. [CrossRef]
  27. B. Birchfield, "Elliptical head tracking using intensity gradients and color histogram," in Proceedings of the International Conference on Pattern Recognition 1998 Computer Vision and Pattern Recognition, (International Society for Pattern Recognition, 1998), pp. 232-237.
  28. J. Triesch and C. van der Malsburg, "Democratic integration: Self-organized integration of adaptive cues," Neural Comput. 13, 2049-2074 (2001). [CrossRef] [PubMed]
  29. J. Vermaak, P. Pérez, M. Gangnet, and A. Blake, "Towards improved observation models for visual tracking: selective adaptation," in Proceedings of the European Conference on Computer Vision 2002 (Springer, 2002), Vol. 1, pp. 645-660 (2002).
  30. P. Pérez, J. Vermaak, and A. Blake, Proc. IEEE 92, 495-513 (2004).
  31. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell. 12, 629-639 (1990). [CrossRef]
  32. Q. Zheng and R. Chellappa, "A computational vision approach to image registration," IEEE Trans. Image Process. 2, 311-326 (1993). [CrossRef] [PubMed]
  33. J. M. Coughlan and S. J. Ferreira, "Finding deformable shapes using loopy belief propagation," in Proceedings of the European Conference on Computer Vision (Springer, 2002), Vol. 3, pp. 453-468.
  34. D. Cremers, T. Kohlberger, and C. Schnörr, "Nonlinear shape statistics in Mumford-Shah based segmentation," in Proceedings of the European Conference on Computer Vision (Springer, 2002), Vol. 2, pp. 93-108.
  35. F. Porikli and O. Tuzel, "Bayesian background modeling for foreground detection," in Proceedings of the ACM Visual Surveillance and Sensor Network (Association for Computing Machinery, 2005), Vol. 3, pp. 55-58. [CrossRef]
  36. T. F. Cootes and C. J. Taylor, "Active shape models," in Proceedings of the 3rd British Machine Vision Conference, D.Hogg and R.Boyle, eds. (Springer, 1992), pp. 266-275.
  37. T. F. Cootes and C. J. Taylor, "Combining point distribution models with shape models based on finite-element analysis," in Proceedings of the 5th British Machine Vision Conference, E.Hancock, ed., (British Machine Vision Association, 1994), pp. 419-428.
  38. X. S. Zhou, D. Comaniciu, and A. Gupta, "An information fusion framework for robust shape tracking," IEEE Trans. Pattern Anal. Mach. Intell. 27, 115-129 (2005). [CrossRef] [PubMed]
  39. P. Hall, D. Marshall, and R. Martin, "Merging and splitting eigenspace models," IEEE Trans. Pattern Anal. Mach. Intell. 22, 1042-1048 (2000). [CrossRef]
  40. H. Nanda and L. Davis, "Probabilistic template based pedestrian detection in infrared videos," in Proceedings of the IEEE Intelligent Vehicle Symposium (IEEE, 2002), pp. 15-20.
  41. Y. Akgul and C. Kambhamettu, "A coarse-to-fine deformable contour optimization framework," IEEE Trans. Pattern Anal. Mach. Intell. 25, 174-186 (2003). [CrossRef]
  42. M. Spengler and B. Schiele, "Towards robust multi-cue integration for visual tracking," Machine Vision Appl. 4, 50-58 (2003). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited