Journals and Proceedings ? Brought to you by The Optical Society

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| JOSA A: OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 2, Iss. 2 — Feb. 1, 1985
  • pp: 284–299

Optics InfoBase > JOSA A > Volume 2 > Issue 2 > Spatiotemporal energy models for the perception of motion

Spatiotemporal energy models for the perception of motion

Edward H. Adelson and James R. Bergen

JOSA A, Vol. 2, Issue 2, pp. 284-299        doi:10.1364/JOSAA.2.000284

» View Full Text: Acrobat PDF (4167 KB) Open Access

Citation
Edward H. Adelson and James R. Bergen, "Spatiotemporal energy models for the perception of motion," J. Opt. Soc. Am. A 2, 284-299 (1985)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-2-2-284

Click for help

Abstract

A motion sequence may be represented as a single pattern in x-y-t space; a velocity of motion corresponds to a three-dimensional orientation in this space. Motion sinformation can be extracted by a system that responds to the oriented spatiotemporal energy. We discuss a class of models for human motion mechanisms in which the first stage consists of linear filters that are oriented in space-time and tuned in spatial frequency. The outputs of quadrature pairs of such filters are squared and summed to give a measure of motion energy. These responses are then fed into an opponent stage. Energy models can be built from elements that are consistent with known physiology and psychophysics, and they permit a qualitative understanding of a variety of motion phenomena.

© 1985 Optical Society of America

» View Full Text: Acrobat PDF (4167 KB) Open Access

References

  1. S. Ullman, The Interpretation of Visual Motion (MIT U. Press, Cambridge, Mass., 1979).
  2. S. M. Anstis, "The perception of apparent movement," Phil. Trans. R. Soc. London Ser. B 290, 153–168 (1980).
  3. S. M. Anstis, "Apparent Movement," in Handbook of Sensory Physiology, Vol. VIII, Perception, R. Held, H. W. Leibowitz, and H.-L. Teuber, eds. (Springer-Verlag, New York, 1977).
  4. J. S. Lappin and H. H. Bell, "Perceptual differentiation of sequential visual patterns," Percept. Psychophys. 12, 129–134 (1972).
  5. D. Marr and S. Ullman, "Direction selectivity and its use in early visual processing," Proc. R. Soc. London Ser. B 211, 151–180 (1981).
  6. J. P. H. van Santen and G. Sperling, "Temporal covariance model of human motion perception," J. Opt. Soc. Am. A 1, 451–473 (1984).
  7. W. Reichardt, "Autocorrelation, a principle for the evaluation of sensory information by the central nervous system," in Sensory Communication, W. A. Rosenblith, ed. (Wiley, New York, 1961).
  8. A. B. Watson and A. J. Ahumada, Jr., "A look at motion in the frequency domain," NASA Tech. Memo. TM-84352 (1983).
  9. J. Ross and D. Burr, "The psychophysics of motion," in Proceedings of the Workshop of Vision, Brain, and Cooperative Computation, M. A. Arbib and A. R. Hanson eds. (U. Massachusetts Press, Amherst, Mass., 1983); Vision, Brain, and Cooperative Computation (Bradford, Amherst, Mass., to be published).
  10. M. J. Morgan, "Perception of continuity in stroboscopic motion: a temporal frequency analysis." Vision Res 19, 491–500 (1979); "Analogue models of motion perception," Phil. Trans. R. Soc. London Ser. B 290, 117–135 (1980).
  11. E. H. Adelson, "Some new illusions, and some old ones, analyzed in terms of their Fourier components," Invest. Opthalmol. Vis. Sci. Suppl. 22, 144 (1982).
  12. E. H. Adelson and J. R. Bergen, "Spatio-temporal energy models for the Perception of Motion," J. Opt. Soc. Am. 73, 1861 (1983).
  13. C. Enroth-Cugell and J. G. Robson, "The contrast sensitivity of retinal ganglion cells of the cat," J. Physiol. London 187, 517–552 (1966).
  14. J. A. Movshon, I. D. Thompson, and D. J. Tolhurst, "Spatial summation in the receptive fields of simple cells in the cat's striate cortex." J. Physiol. (London) 283, 79–99 (1978).
  15. F. W. Campbell and J. G. Robson, "Application of Fourier analysis to the visibility of gratings," J. Physiol. (London) 197, 551–566 (1968).
  16. H. R. Wilson, and J. R. Bergen, "A four mechanism model for threshold spatial vision," Vision Res. 19, 19–33 (1979).
  17. O. Braddick, "A short-range process in apparent motion," Vision Res. 14, 519–529, (1974); "Low-level and high-level processes in apparent motion," Phil. Trans. R. Soc. London B 290, 137–151 (1980).
  18. J. Hochberg, and V. Brooks, "The perception of motion pictures," in Handbook of Perception, E. C. Carterette and M. Friedmen, eds. (Academic, New York, 1978), Vol. 10.
  19. G. Sperling, "Movement perception in computer-driven visual displays," Behav. Res. Methods Instrum. 8, 144–151 (1976).
  20. P. Burt and G. Sperling, "Time, distance, and feature trade-offs in visual apparent motion," Psych. Rev. 88, 171–195 (1981).
  21. A. J. Pantle and L. Picciano, "A multi-stable movement display: Evidence for two separate motion systems in humans," Science 193, 500–502 (1976).
  22. D. E. Pearson, Transmission and Display of Pictorial Information (Wiley, New York, 1975).
  23. A. B. Watson, A. Ahumada, Jr., and J. E. Farrell, "The window of visibility: a psychophysical theory of fidelity in time-sampled visual motion displays," NASA Tech. Paper TP-2211 (1983).
  24. D. H. Hubel and T. N. Wiesel, "Receptive fields of single neurones in the cat's striate cortex," J. Physiol. (London) 148, 574–591 (1959).
  25. D. H. Tolhurst and J. A. Movshon, "Spatial and temporal contrast sensitivity of striate cortical neurons," Nature 257, 674–675 (1975).
  26. J. A. Movshon, I. D. Thompson, and D. J. Tolhurst, "Spatial and temporal contrast sensitivity of neurons in areas 17 and 18 of the cat's visual contex," J. Physiol. (London) 283, 101–120 (1978).
  27. A. B. Watson and A. J. Ahumada, Jr., "A model of how humans sense image motion," Invest. Opthalmol. Vis. Sci. Suppl. 25, 14 (1984).
  28. A. Pantle and R. Sekuler, "Contrast response of human visual mechanisms sensitive to orientation and motion." Vision Res. 9, 397–406 (1969).
  29. J. R. Bergen and H. R. Wilson, "Prediction of flicker sensitivities from temporal three pulse data," Vision Res. (to be published).
  30. J. G. Robson, "Spatial and temporal contrast sensitivity functions of the visual system," J. Opt. Soc. Am. 56, 1141–1142 (1966).
  31. D. H. Kelly, "Motion and vision, II. Stabilized spatio-temporal threshold surface," J. Opt. Soc. Am. 69, 1340–1349 (1979).
  32. T. J. Long, "Why not compatible high-definition television?" IBA Tech. Rev. 21, 4–12 (1983); T. S. Robson, "Extended-definition television service," Proc. IEE 129, 485–489 (1982).
  33. A. B. Watson and J. G. Robson, "Discrimination at threshold: labelled detectors in human vision," Vision Res. 21, 1115–1122 (1981).
  34. P. Thompson, "The coding of velocity of movement in the human visual system," Vision Res. 24, 41–45 (1984).
  35. D. J. Tolhurst, "Sustained and transient channels in human vision," Vision Res. 15, 1151–1155 (1975).
  36. E. Levinson and R. Sekuler, "The independence of channels in human vision selective for direction of movement," J. Physiol. London 250, 347–366 (1975).
  37. A. B. Watson, P. G. Thompson, B. J. Murphy, and J. Nachmias, "Summation and discrimination of gratings moving in opposite directions," Vision Res. 20, 341–347 (1980).
  38. C. F. Stromeyer III, R. E. Kronauer, J. C. Madsen, and S. A. Klein, "Opponent mechanisms in human vision," J. Opt. Soc. Am. A 1, 876–884 (1984).
  39. P. Thompson, "Perceived rate of movement depends on contrast," Vision Res. 22, 377–380 (1982).
  40. S. M. Anstis and B. J. Rogers, "Illusory reversal of visual depth and movement during changes of contrast," Vision Res. 15, 957–961 (1975).
  41. S. M. Anstis, Department of Psychology, York University, Toronto, Ontario, Canada (personal communication, 1981).
  42. E. H. Adelson and J. A. Movshon "Phenomenal coherence of moving gratings," Nature 200, 523–525 (1982).
  43. M. Fahle and T. Poggio, "Visual hyperacuity: spatio-temporal interpolation in human vision," Proc. R. Soc. London Ser. B 213, 451–477 (1981).

Author Affiliations

Edward H. Adelson, James R. Bergen

David Sarnoff Research Center, RCA, Princeton, New Jersey 08540

Cited By

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Click for help

 

OSA is a member of CrossRef.

CrossCheck Deposited



Advanced Search

Recent ToC Categories (Beta)

Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

More News