OSA's Digital Library

Applied Optics

Applied Optics

APPLICATIONS-CENTERED RESEARCH IN OPTICS

  • Vol. 26, Iss. 23 — Dec. 1, 1987
  • pp: 5061–5076

Multilayer optical learning networks

Kelvin Wagner and Demetri Psaltis  »View Author Affiliations


Applied Optics, Vol. 26, Issue 23, pp. 5061-5076 (1987)
http://dx.doi.org/10.1364/AO.26.005061


View Full Text Article

Enhanced HTML    Acrobat PDF (3002 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

A new approach to learning in a multilayer optical neural network based on holographically interconnected nonlinear devices is presented. The proposed network can learn the interconnections that form a distributed representation of a desired pattern transformation operation. The interconnections are formed in an adaptive and self-aligning fashion as volume holographic gratings in photorefractive crystals. Parallel arrays of globally space-integrated inner products diffracted by the interconnecting hologram illuminate arrays of nonlinear Fabry-Perot etalons for fast thresholding of the transformed patterns. A phase conjugated reference wave interferes with a backward propagating error signal to form holographic interference patterns which are time integrated in the volume of a photorefractive crystal to modify slowly and learn the appropriate self-aligning interconnections. This multilayer system performs an approximate implementation of the backpropagation learning procedure in a massively parallel high-speed nonlinear optical network.

© 1987 Optical Society of America

History
Original Manuscript: May 28, 1987
Published: December 1, 1987

Citation
Kelvin Wagner and Demetri Psaltis, "Multilayer optical learning networks," Appl. Opt. 26, 5061-5076 (1987)
http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-26-23-5061


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. D. E. Rumelhart, G. E. Hinton, R. J. Williams, “Learning Internal Representations by Error Propagation,” in Parallel Distributed Processing, Vol. 1, D. E. Rumelhart, J. L. McClelland, Eds. (MIT Press, Cambridge, MA, 1986), Chap. 8.
  2. D. B. Parker, “Learning Logic,” Invention Report S81-64, File 1, Office of Technology Licensing, Stanford U. (Oct.1982).
  3. J. J. Hopfield, “Neurons with Graded Response have Collective Computational Properties like those of Two-State Neurons,” Proc. Natl. Acad. Sci. USA 81, 3088 (1984). [CrossRef] [PubMed]
  4. S. Grossberg, Studies of Mind and Brain (Reidel, Boston, 1982). [CrossRef]
  5. T. Kohonen, Self-Organization and Associative Memory (Springer-Verlag, Berlin, 1984).
  6. Y. S. Abu-Mostafa, D. Psaltis, “Optical Neural Computers,” Sci. Am. 256, 88 (1987). [CrossRef]
  7. D. Psaltis, N. H. Farhat, “Optical Information Processing Based on an Associative Memory Model of Neural Nets with Thresholding and Feedback,” Opt. Lett 10, 98 (1985). [CrossRef] [PubMed]
  8. D. Z. Anderson, “Coherent Optical Eigenstate Memory,” Opt. Lett. 11, 56 (1986). [CrossRef] [PubMed]
  9. B. H. Soffer, G. J. Dunning, Y. Owechko, E. Marom, “Associative Holographic Memory with Feedback Using Phase-Conjugate Mirrors,” Opt. Lett. 11, 118 (1986). [CrossRef] [PubMed]
  10. A. Yariv, S. Kwong, “Associative Memories Based on Message-Bearing Optical Modes in Phase Conjugate Resonators,” Opt. Lett. 11, 186 (1986). [CrossRef] [PubMed]
  11. T. Jannson et al., “The Interconnectability of Neuro-Optic Processors,” Proc. Soc. Photo-Opt. Instrum. Eng. 698, 157 (1986).
  12. A. D. Fisher et al., “Implementation of Adaptive Associative Optical Computing Elements,” Proc. Soc. Photo-Opt. Instrum. Eng. 525, 196 (1986).
  13. M. Cohen, “Design of a New Medium for Volume Holographic Information Processing,” Appl. Opt. 25, 2288 (1986). [CrossRef] [PubMed]
  14. N. Farhat, “Architectures for Opto-Electronic Analogs of Self-Organizing Neural Networks,” in Technical Digest of Topical Meeting on Optical Computing (Optical Society of America, Washington, DC, 1987), p. 125.
  15. K. Wagner, D. Psaltis, “Multilayer Optical Learning Networks,” Proc. Soc. Photo-Opt. Instrum. Eng. 752, 16 (1987).
  16. K. Wagner, D. Psaltis, “Multilayer Optical Learning Networks,” in Technical Digest, Topical Meeting on Optical Computing (Optical Society of America, Washington, DC, 1987), p. 133.
  17. D. Psaltis, C. Park, “Nonlinear Discriminant Functions and Associative Memories,” in Proceedings, Conference on Neural Networks for Computing, Snowbird, UT, APS Conf. Proc.151 (1986).
  18. T. J. Sejnowski, C. R. Rosenberg, “NETtalk: a Parallel-Network that Learns to Read Aloud,” John Hopkins U., JHU/ EECS-86/01 (1986).
  19. B. Widrow, M. E. Hoff, “Adaptive Switching Circuits,” IRE Wescon Conv. Rec. 4, 96 (1960).
  20. H. M. Gibbs, Optical Bistability: Controlling Light with Light (Academic, New York, 1985).
  21. H. M. Gibbs et al., “Optical Modulation by Optical Tuning of a Cavity,” Appl. Phys. Lett. 34, 511 (1979). [CrossRef]
  22. A. W. Lohmann, “Polarization and Optical Logic,” Appl. Opt. 25,1594 (1986). [CrossRef] [PubMed]
  23. D. Psaltis et al., “Optical Neural Nets Implemented with Volume Holograms,” in Technical Digest Topical Meeting on Optical Computing (Optical Society of America, Washington, DC, 1987).
  24. J. P. Huignard et al., “Coherent Selective Erasure of Superimposed Volume Holograms in LiNbO3,” Appl. Phys. Lett. 26, 256 (1975). [CrossRef]
  25. D. L. Stabler et al., “Multiplier Storage and Erasure of Fixed Holograms in Fe-Doped LiNbO3,” Appl. Phys. Lett. 26, 182 (1975). [CrossRef]
  26. J. D. Cresser, P. Meystre, “The Role of Phases in the Trasient Dynamics of Nonlinear Interferometers,” in Optical Bistability, C. M. Bowden Ed. (Plenum, New York, 1980).
  27. A. Merrakchi, R. V. Johnson, A. Tanguay, “Polarization Properties of Photorefractive Diffraction in Electrooptic and Optically Active Sillenite Crystals (Bragg Regime),” J. Opt. Soc. Am. B. 3, 321 (1986). [CrossRef]
  28. A. E. Chiou, P. Yeh, “Parallel Image Subtraction Using a Phase Conjugate Michelson Interferometer,” Opt. Lett. 11, 306 (1986). [CrossRef] [PubMed]
  29. J. L. Jewell et al., “3pJ 82MHz Optical Logic Gates in a Room Temperature GaAs-AlGaAs Multiple Quantum Well Etalon,” Appl. Phys. Lett. 46, 918 (1985). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited