OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 20, Iss. 8 — Aug. 1, 2003
  • pp: 1505–1515

Fast two-frame multiscale dense optical flow estimation using discrete wavelet filters

Haiying Liu, Rama Chellappa, and Azriel Rosenfeld  »View Author Affiliations


JOSA A, Vol. 20, Issue 8, pp. 1505-1515 (2003)
http://dx.doi.org/10.1364/JOSAA.20.001505


View Full Text Article

Enhanced HTML    Acrobat PDF (1167 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

A multiscale algorithm with complexity O(N) (where N is the number of pixels in one image) using wavelet filters is proposed to estimate dense optical flow from two frames. Hierarchical image representation by wavelet decomposition is integrated with differential techniques in a new multiscale framework. It is shown that if a compactly supported wavelet basis with one vanishing moment is carefully selected, hierarchical image, first-order derivative, and corner representations can be obtained from the wavelet decomposition. On the basis of this result, three of the four components of the wavelet decomposition are employed to estimate dense optical flow with use of only two frames. This overcomes the “flattening-out” problem in traditional pyramid methods, which produce large errors when low-texture regions become flat at coarse levels as a result of blurring. A two-dimensional affine motion model is used to formulate the optical flow problem as a linear system, with all resolutions simultaneously (i.e., coarse-and-fine) rather than the traditional coarse-to-fine approach, which unavoidably propagates errors from the coarse level. This not only helps to improve the accuracy but also makes the hardware implementation of our algorithm simple. Experiments on different types of image sequences, together with quantitative and qualitative comparisons with several other optical flow methods, are given to demonstrate the effectiveness and the robustness of our algorithm.

© 2003 Optical Society of America

OCIS Codes
(100.2000) Image processing : Digital image processing
(100.2960) Image processing : Image analysis
(150.4620) Machine vision : Optical flow

History
Original Manuscript: October 10, 2002
Revised Manuscript: April 1, 2003
Manuscript Accepted: April 1, 2003
Published: August 1, 2003

Citation
Haiying Liu, Rama Chellappa, and Azriel Rosenfeld, "Fast two-frame multiscale dense optical flow estimation using discrete wavelet filters," J. Opt. Soc. Am. A 20, 1505-1515 (2003)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-20-8-1505


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. J. Gibson, The Senses Considered as Perceptual Systems (Houghton Mifflin, Boston, 1966).
  2. J. Oliensis, “A critique of structure-from-motion algorithms,” Comput. Vis. Image Underst. 80, 172–214 (2000). [CrossRef]
  3. G. J. Young, R. Chellappa, “3-D motion estimation using a sequence of noisy stereo images: models, estimation and uniqueness results,” IEEE Trans. Pattern Anal. Mach. Intell. 14, 995–1013 (1992). [CrossRef]
  4. J. Duncan, T. Chou, “On the detection of motion and the computation of optical flow,” IEEE Trans. Pattern Anal. Mach. Intell. 14, 346–352 (1992). [CrossRef]
  5. K. Prazdny, “Determining the instantaneous direction of motion from optical flow generated by a curvilinearly moving observer,” Comput. Graph. Image Process. 17, 82–87 (1981). [CrossRef]
  6. Y. Aloimonos, Z. Duric, “Estimating the heading direction using normal flow,” Int. J. Comput. Vision 13, 33–56 (1994). [CrossRef]
  7. M. Hashimoto, J. Sklansky, “Multiple-order derivatives for detecting local image characteristics,” Comput. Vision Image Understand. 39, 28–55 (1987). [CrossRef]
  8. W. Thompson, K. Mutch, V. Berzins, “Dynamic occlusion analysis in optical flow fields,” IEEE Trans. Pattern Anal. Mach. Intell. 7, 374–383 (1985). [CrossRef] [PubMed]
  9. W.-S. Chou, Y.-C. Chen, “Estimation of the velocity field of two-dimensional deformable motion,” Pattern Recogn. 26, 351–364 (1993). [CrossRef]
  10. J. Gibson, “Optical motions and transformations as stimuli for visual perception,” Psychol. Rev. 64, 288–295 (1957). [CrossRef] [PubMed]
  11. S. Ullman, “The interpretation of structure from motion,” Proc. R. Soc. London Ser. B 203, 405–426 (1979). [CrossRef]
  12. J. L. Barron, D. J. Fleet, S. S. Beauchemin, “Performance of optical flow techniques,” Int. J. Comput. Vision 12, 43–77 (1994). [CrossRef]
  13. P. J. Sobey, M. V. Srinivasan, “Measurement of complex optical flow with use of an augmented generalized gradient scheme,” J. Opt. Soc. Am. A 11, 2787–2798 (1994). [CrossRef]
  14. P. J. Sobey, M. G. Nagle, Y. V. Venkatesh, M. V. Srinivasan, “Measurement of optical flow by a generalized gradient scheme,” J. Opt. Soc. Am. A 8, 1488–1498 (1991). [CrossRef]
  15. A. G. Borş, I. Pitas, “Optical flow estimation and moving object segmentation based on median radial basis function network,” IEEE Trans. Image Process. 7, 693–702 (1998). [CrossRef]
  16. E. Meminémin, P. Pérez, “Dense estimation and object-based segmentation of the optical flow with robust techniques,” IEEE Trans. Image Process. 7, 703–719 (1998). [CrossRef]
  17. J. N. Pan, Y. Q. Shi, C. Q. Shu, “Correlation-feedback technique in optical flow determination,” IEEE Trans. Image Process. 7, 1061–1067 (1998). [CrossRef]
  18. Y. T. Wu, T. Kanade, J. Cohn, C. C. Li, “Optical flow estimation using wavelet motion model,” in Proceedings of the IEEE International Conference on Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 1998), pp. 992–998.
  19. M. Hemmendorff, M. T. Andersson, H. Knutsson, “Phase-based image motion estimation and registration,” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (Institute of Electrical and Electronics Engineers, New York, 1999), pp. 3345–3348.
  20. J. Magarey, N. Kingsbury, “Motion estimation using a complex-value wavelet transform,” IEEE Trans. Signal Process. 46, 1069–1084 (1998). [CrossRef]
  21. F. A. Mujica, J. P. Leduc, R. Murenzi, M. J. T. Smith, “A new motion parameter estimation algorithm based on the continuous wavelet transform,” IEEE Trans. Image Process. 9, 873–888 (2000). [CrossRef]
  22. C. P. Bernard, “Discrete wavelet analysis: a new framework for fast optical flow computation,” in Proceedings of the European Conference on Computer Vision (Springer, Freiburg, Germany, 1998), pp. 354–368.
  23. A. D. Bimbo, P. Nesi, J. L. C. Sanz, “Optical flow computation using extended constraints,” IEEE Trans. Image Process. 5, 720–739 (1996). [CrossRef] [PubMed]
  24. S. Ghosal, P. Vaněk, “A fast scalable algorithm for discontinuous optical flow estimation,” IEEE Trans. Pattern Anal. Mach. Intell. 18, 181–194 (1996). [CrossRef]
  25. H. W. Haussecker, D. J. Fleet, “Computing optical flow with physical models of brightness variation,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 661–673 (2001). [CrossRef]
  26. A. Kumar, A. R. Tannenbaum, G. J. Balas, “Optical flow: a curve evolution approach,” IEEE Trans. Image Process. 5, 598–610 (1996). [CrossRef] [PubMed]
  27. H. Liu, T. H. Hong, M. Herman, R. Chellappa, “A general motion model and spatio-temporal filters for computing optical flow,” Int. J. Comput. Vis. 22, 141–172 (1997). [CrossRef]
  28. S. Rakshit, C. H. Anderson, “Computation of optical flow using basis functions,” IEEE Trans. Image Process. 6, 1246–1254 (1997). [CrossRef] [PubMed]
  29. H. Spies, H. Scharr, “Acurate optical flow in noisy image sequences,” in Proceedings of the IEEE International Conference on Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 2001), pp. 587–592.
  30. S. Srinivasan, R. Chellappa, “Noise-resilient estimation of optical flow by use of overlapped basis functions,” J. Opt. Soc. Am. A 16, 493–507 (1999). [CrossRef]
  31. M. Tistarelli, “Multiple constraints to compute optical flow,” IEEE Trans. Pattern Anal. Mach. Intell. 18, 1243–1250 (1996). [CrossRef]
  32. M. Yeasin, “Optical flow in log-mapped image plane—a new approach,” IEEE Trans. Pattern Anal. Mach. Intell. 24, 125–131 (2002). [CrossRef]
  33. J. Weber, J. Malik, “Robust computation of optical flow in a multi-scale differential framework,” Int. J. Comput. Vision 14, 67–81 (1995). [CrossRef]
  34. J. Mendelsohn, E. Simoncelli, R. Bajcsy, “Discrete-time rigidity-constrained optical flow,” in Proceedings of the International Conference on Computer Analysis of Images and Patterns (IEEE Computer Society Press, Los Alamitos, Calif., 1997), pp. 255–262.
  35. H. Liu, T. Hong, M. Herman, T. Camus, R. Chellapa, “Accuracy vs. efficiency trade-off in optical flow algorithms,” Comput. Vision Image Understand. 72, 271–286 (1998). [CrossRef]
  36. H. Haussecker, H. Spies, Handbook of Computer Vision and Applications Volume 2: Signal Processing and Pattern Recognition (New York, Academic Press, 1999), chap. 13: Motion, pp. 309–396.
  37. I. Daubechies, Ten Lectures on Wavelets (Society for Industrial and Applied Mathematics, Philadelphia, Pa., 1992).
  38. S. G. Mallat, “A theory for multiresolution signal decomposition: the wavelet representation,” IEEE Trans. Pattern Anal. Mach. Intell. 11, 674–693 (1989). [CrossRef]
  39. G. H. Golub, C. F. V. Loan, Matrix Computations (Johns Hopkins U. Press, Baltimore, Md., 1996).
  40. D. J. Fleet, A. D. Jepson, “Computation of component image velocity from local phase information,” Int. J. Comput. Vision 5, 77–104 (1990). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited