## Fast two-frame multiscale dense optical flow estimation using discrete wavelet filters

JOSA A, Vol. 20, Issue 8, pp. 1505-1515 (2003)

http://dx.doi.org/10.1364/JOSAA.20.001505

Acrobat PDF (1167 KB)

### Abstract

A multiscale algorithm with complexity *O*(*N*) (where *N* is the number of pixels in one image) using wavelet filters is proposed to estimate dense optical flow from two frames. Hierarchical image representation by wavelet decomposition is integrated with differential techniques in a new multiscale framework. It is shown that if a compactly supported wavelet basis with one vanishing moment is carefully selected, hierarchical image, first-order derivative, and corner representations can be obtained from the wavelet decomposition. On the basis of this result, three of the four components of the wavelet decomposition are employed to estimate dense optical flow with use of only two frames. This overcomes the “flattening-out” problem in traditional pyramid methods, which produce large errors when low-texture regions become flat at coarse levels as a result of blurring. A two-dimensional affine motion model is used to formulate the optical flow problem as a linear system, with all resolutions simultaneously (i.e., coarse-and-fine) rather than the traditional coarse-to-fine approach, which unavoidably propagates errors from the coarse level. This not only helps to improve the accuracy but also makes the hardware implementation of our algorithm simple. Experiments on different types of image sequences, together with quantitative and qualitative comparisons with several other optical flow methods, are given to demonstrate the effectiveness and the robustness of our algorithm.

© 2003 Optical Society of America

**OCIS Codes**

(100.2000) Image processing : Digital image processing

(100.2960) Image processing : Image analysis

(150.4620) Machine vision : Optical flow

**Citation**

Haiying Liu, Rama Chellappa, and Azriel Rosenfeld, "Fast two-frame multiscale dense optical flow estimation using discrete wavelet filters," J. Opt. Soc. Am. A **20**, 1505-1515 (2003)

http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-20-8-1505

Sort: Year | Journal | Reset

### References

- J. Gibson, The Senses Considered as Perceptual Systems (Houghton Mifflin, Boston, 1966).
- J. Oliensis, “A critique of structure-from-motion algorithms,” Comput. Vis. Image Underst. 80, 172–214 (2000).
- G. J. Young and R. Chellappa, “3-D motion estimation using a sequence of noisy stereo images: models, estimation and uniqueness results,” IEEE Trans. Pattern Anal. Mach. Intell. 14, 995–1013 (1992).
- J. Duncan and T. Chou, “On the detection of motion and the computation of optical flow,” IEEE Trans. Pattern Anal. Mach. Intell. 14, 346–352 (1992).
- K. Prazdny, “Determining the instantaneous direction of motion from optical flow generated by a curvilinearly moving observer,” Comput. Graph. Image Process. 17, 82–87 (1981).
- Y. Aloimonos and Z. Duric, “Estimating the heading direction using normal flow,” Int. J. Comput. Vision 13, 33–56 (1994).
- M. Hashimoto and J. Sklansky, “Multiple-order derivatives for detecting local image characteristics,” Comput. Vision Image Understand. 39, 28–55 (1987).
- W. Thompson, K. Mutch, and V. Berzins, “Dynamic occlusion analysis in optical flow fields,” IEEE Trans. Pattern Anal. Mach. Intell. 7, 374–383 (1985).
- W.-S. Chou and Y.-C. Chen, “Estimation of the velocity field of two-dimensional deformable motion,” Pattern Recogn. 26, 351–364 (1993).
- J. Gibson, “Optical motions and transformations as stimuli for visual perception,” Psychol. Rev. 64, 288–295 (1957).
- S. Ullman, “The interpretation of structure from motion,” Proc. R. Soc. London Ser. B 203, 405–426 (1979).
- J. L. Barron, D. J. Fleet, and S. S. Beauchemin, “Performance of optical flow techniques,” Int. J. Comput. Vision 12, 43–77 (1994).
- P. J. Sobey and M. V. Srinivasan, “Measurement of complex optical flow with use of an augmented generalized gradient scheme,” J. Opt. Soc. Am. A 11, 2787–2798 (1994).
- P. J. Sobey, M. G. Nagle, Y. V. Venkatesh, and M. V. Srinivasan, “Measurement of optical flow by a generalized gradient scheme,” J. Opt. Soc. Am. A 8, 1488–1498 (1991).
- A. G. Borş and I. Pitas, “Optical flow estimation and moving object segmentation based on median radial basis function network,” IEEE Trans. Image Process. 7, 693–702 (1998).
- E. Meminémin and P. Pérez, “Dense estimation and object-based segmentation of the optical flow with robust techniques,” IEEE Trans. Image Process. 7, 703–719 (1998).
- J. N. Pan, Y. Q. Shi, and C. Q. Shu, “Correlation-feedback technique in optical flow determination,” IEEE Trans. Image Process. 7, 1061–1067 (1998).
- Y. T. Wu, T. Kanade, J. Cohn, and C. C. Li, “Optical flow estimation using wavelet motion model,” in Proceedings of the IEEE International Conference on Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 1998), pp. 992–998.
- M. Hemmendorff, M. T. Andersson, and H. Knutsson, “Phase-based image motion estimation and registration,” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (Institute of Electrical and Electronics Engineers, New York, 1999), pp. 3345–3348.
- J. Magarey and N. Kingsbury, “Motion estimation using a complex-value wavelet transform,” IEEE Trans. Signal Process. 46, 1069–1084 (1998).
- F. A. Mujica, J. P. Leduc, R. Murenzi, and M. J. T. Smith, “A new motion parameter estimation algorithm based on the continuous wavelet transform,” IEEE Trans. Image Process. 9, 873–888 (2000).
- C. P. Bernard, “Discrete wavelet analysis: a new framework for fast optical flow computation,” in Proceedings of the European Conference on Computer Vision (Springer, Freiburg, Germany, 1998), pp. 354–368.
- A. D. Bimbo, P. Nesi, and J. L. C. Sanz, “Optical flow computation using extended constraints,” IEEE Trans. Image Process. 5, 720–739 (1996).
- S. Ghosal and P. Vaněk, “A fast scalable algorithm for discontinuous optical flow estimation,” IEEE Trans. Pattern Anal. Mach. Intell. 18, 181–194 (1996).
- H. W. Haussecker and D. J. Fleet, “Computing optical flow with physical models of brightness variation,” IEEE Trans. Pattern Anal. Mach. Intell. 23, 661–673 (2001).
- A. Kumar, A. R. Tannenbaum, and G. J. Balas, “Optical flow: a curve evolution approach,” IEEE Trans. Image Process. 5, 598–610 (1996).
- H. Liu, T. H. Hong, M. Herman, and R. Chellappa, “A general motion model and spatio-temporal filters for computing optical flow,” Int. J. Comput. Vis. 22, 141–172 (1997).
- S. Rakshit and C. H. Anderson, “Computation of optical flow using basis functions,” IEEE Trans. Image Process. 6, 1246–1254 (1997).
- H. Spies and H. Scharr, “Acurate optical flow in noisy image sequences,” in Proceedings of the IEEE International Conference on Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 2001), pp. 587–592.
- S. Srinivasan and R. Chellappa, “Noise-resilient estimation of optical flow by use of overlapped basis functions,” J. Opt. Soc. Am. A 16, 493–507 (1999).
- M. Tistarelli, “Multiple constraints to compute optical flow,” IEEE Trans. Pattern Anal. Mach. Intell. 18, 1243–1250 (1996).
- M. Yeasin, “Optical flow in log-mapped image plane—a new approach,” IEEE Trans. Pattern Anal. Mach. Intell. 24, 125–131 (2002).
- J. Weber and J. Malik, “Robust computation of optical flow in a multi-scale differential framework,” Int. J. Comput. Vision 14, 67–81 (1995).
- J. Mendelsohn, E. Simoncelli, and R. Bajcsy, “Discrete-time rigidity-constrained optical flow,” in Proceedings of the International Conference on Computer Analysis of Images and Patterns (IEEE Computer Society Press, Los Alamitos, Calif., 1997), pp. 255–262.
- H. Liu, T. Hong, M. Herman, T. Camus, and R. Chellapa, “Accuracy vs. efficiency trade-off in optical flow algorithms,” Comput. Vision Image Understand. 72, 271–286 (1998).
- H. Haussecker and H. Spies, Handbook of Computer Vision and Applications Volume 2: Signal Processing and Pattern Recognition (New York, Academic Press, 1999), chap. 13: Motion, pp. 309–396.
- I. Daubechies, Ten Lectures on Wavelets (Society for Industrial and Applied Mathematics, Philadelphia, Pa., 1992).
- S. G. Mallat, “A theory for multiresolution signal decomposition: the wavelet representation,” IEEE Trans. Pattern Anal. Mach. Intell. 11, 674–693 (1989).
- G. H. Golub and C. F. V. Loan, Matrix Computations (Johns Hopkins U. Press, Baltimore, Md., 1996).
- D. J. Fleet and A. D. Jepson, “Computation of component image velocity from local phase information,” Int. J. Comput. Vision 5, 77–104 (1990).

## Cited By |
Alert me when this paper is cited |

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article | Next Article »

OSA is a member of CrossRef.