OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A


  • Editor: Stephen A. Burns
  • Vol. 26, Iss. 6 — Jun. 1, 2009
  • pp: 1393–1402

Inverse optical imaging viewed as a backward channel communication problem

Enrico De Micheli and Giovanni Alberto Viano  »View Author Affiliations

JOSA A, Vol. 26, Issue 6, pp. 1393-1402 (2009)

View Full Text Article

Enhanced HTML    Acrobat PDF (190 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



The inverse problem in optics, which is closely related to the classical question of the resolving power, is reconsidered as a communication channel problem. The main result is the evaluation of the maximum number M ε of ε-distinguishable messages (ε being a bound on the noise of the image) that can be conveyed back from the image to reconstruct the object. We study the case of coherent illumination. By using the concept of Kolmogorov’s ε-capacity, we obtain M ε 2 S log ( 1 ε ) for ε 0 , where S is the Shannon number. Moreover, we show that the ε-capacity in inverse optical imaging is nearly equal to the amount of information on the object that is contained in the image. We thus compare the results obtained through the classical information theory—which is based on probability theory—with those derived from a form of topological information theory, based on the Kolmogorov ε-entropy and ε-capacity, which are concepts related to the evaluation of the massiveness of compact sets.

© 2009 Optical Society of America

OCIS Codes
(100.3190) Image processing : Inverse problems
(110.3055) Imaging systems : Information theoretical analysis

ToC Category:
Image Processing

Original Manuscript: February 27, 2009
Manuscript Accepted: April 6, 2009
Published: May 21, 2009

Enrico De Micheli and Giovanni Alberto Viano, "Inverse optical imaging viewed as a backward channel communication problem," J. Opt. Soc. Am. A 26, 1393-1402 (2009)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. H. Wolter, “On basic analogies and principal differences between optical and electronic information,” in Progress in Optics, Vol. I, E.Wolf, ed. (North Holland, 1961), pp. 155-210. [CrossRef]
  2. G. Toraldo di Francia, “Degrees of freedom of an image,” J. Opt. Soc. Am. 59, 799-804 (1969), and references cited therein. [CrossRef] [PubMed]
  3. J. Hadamard, Lectures on the Cauchy Problem in Linear Partial Differential Equations (Yale U. Press, 1923).
  4. G. A. Viano, “On the extrapolation of optical image data,” J. Math. Phys. 17, 1160-1165 (1976). [CrossRef]
  5. M. Bertero, C. De Mol, and G. A. Viano, “The stability of inverse problems,” in Inverse Scattering Problems in Optics, H.P.Baltes, ed., Topics in Current Physics, Vol. 20 (Springer, 1980), pp. 161-214. [CrossRef]
  6. M. Born and E. Wolf, Principles of Optics (Pergamon, 1959), p. 166.
  7. A. Stern and B. Javidi, “Shannon number and information capacity of three-dimensional integral imaging,” J. Opt. Soc. Am. A 21, 1602-1612 (2004). [CrossRef]
  8. A. Tikhonov and V. Arsenine, Méthodes de Résolution de Problèmes Mal Poses (Mir, 1976).
  9. C. W. Groetsch, The Theory of Tikhonov Regularization for Fredholm Integral Equations of the First Kind (Pitman, 1984).
  10. J. M. Franklin, “Well-posed stochastic extensions of ill-posed linear problems,” J. Math. Anal. Appl. 31, 682-716 (1970). [CrossRef]
  11. E. De Micheli, N. Magnoli, and G. A. Viano, “On the regularization of Fredholm integral equations of the first kind,” SIAM J. Math. Anal. 29, 855-877 (1998). [CrossRef]
  12. A. N. Kolmogorov and V. M. Tihomirov, “ε-entropy and ε-capacity of sets in fuctional spaces,” Am. Math. Soc. Transl. 17, 277-364 (1961).
  13. D. Gabor, “Light and information,” in Progress in Optics, Vol. I, E.Wolf, ed. (North Holland, 1961), pp. 111-153.
  14. D. Slepian and H. O. Pollack, “Prolate spheroidal wave functions, Fourier analysis and uncertainty--I,” Bell Syst. Tech. J. 40, 43-64 (1961).
  15. D. Slepian, “Prolate spheroidal wave functions, Fourier analysis and uncertainty--IV: Extension to many dimensions; Generalized prolate spheroidal wave functions,” Bell Syst. Tech. J. 43, 3009-3057 (1964).
  16. D. Slepian and E. Sonnenblick, “Eigenvalues associated with prolate spheroidal wave functions of zero order,” Bell Syst. Tech. J. 44, 1745-1759 (1965).
  17. B. R. Frieden, “Evaluation, design, and extrapolation methods for optical signals, based on use of the prolate functions,” in Progress in Optics, Vol. IX, E.Wolf, ed. (North Holland, 1972), pp. 311-407.
  18. N. Magnoli and G. A. Viano, “The source identification problem in electromagnetic theory,” J. Math. Phys. 38, 2366-2388 (1997). [CrossRef]
  19. A. V. Balakrishnan, Applied Functional Analysis (Springer-Verlag, 1976), Chap. 6.
  20. D. Middleton, An Introduction to Statistical Communication Theory (McGraw-Hill, 1960), Chap. 6.
  21. E. De Micheli and G. A. Viano, “Probabilistic regularization in inverse optical imaging,” J. Opt. Soc. Am. A 17, 1942-1951 (2000). [CrossRef]
  22. G. G. Lorentz, Approximation of Functions (Holt, Rinehart and Winston, 1966), Chap. 10.
  23. E. De Micheli and G. A. Viano, “Metric and probabilistic information associated with Fredholm integral equations of the first kind,” J. Integral Equ. Appl. 14, 283-309 (2002). [CrossRef]
  24. R. T. Prosser, “The ε-entropy and ε-capacity of certain time-varying channels,” J. Math. Anal. Appl. 16, 553-573 (1966). [CrossRef]
  25. I. M. Gelfand and N. Ya. Vilenkin, Generalized Functions IV, Applications of Harmonic Analysis (Academic, 1964).
  26. I. M. Gelfand and A. M. Yaglom, “Calculation of the amount of information about a random function contained in another such function,” Am. Math. Soc. Transl. 12, 199-246 (1959).
  27. A. J. Jerri, “The Shannon sampling theorem--its various extensions and applications: A tutorial review,” Proc. IEEE 65, 1565-1596 (1977). [CrossRef]
  28. T. Kato, Perturbation Theory for Linear Operators (Springer, 1966), p. 522.
  29. F. Gori and G. Guattari, “Shannon number and degrees of freedom of an image,” Opt. Commun. 7, 163-165 (1973). [CrossRef]
  30. M. Bertero and C. De Mol, “Super-resolution by data inversion,” in Progress in Optics, Vol. XXXVI, E.Wolf, ed. (North-Holland, 1996), pp. 129-178. [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


Fig. 1 Fig. 2

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited