OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 15, Iss. 6 — Jun. 1, 1998
  • pp: 1520–1535

Objective assessment of image quality. III. ROC metrics, ideal observers, and likelihood-generating functions

Harrison H. Barrett, Craig K. Abbey, and Eric Clarkson  »View Author Affiliations


JOSA A, Vol. 15, Issue 6, pp. 1520-1535 (1998)
http://dx.doi.org/10.1364/JOSAA.15.001520


View Full Text Article

Acrobat PDF (402 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We continue the theme of previous papers [J. Opt. Soc. Am. A7, 1266 (1990); J. Opt. Soc. Am. A12, 834 (1995)] on objective (task-based) assessment of image quality. We concentrate on signal-detection tasks and figures of merit related to the ROC (receiver operating characteristic) curve. Many different expressions for the area under an ROC curve (AUC) are derived for an arbitrary discriminant function, with different assumptions on what information about the discriminant function is available. In particular, it is shown that AUC can be expressed by a principal-value integral that involves the characteristic functions of the discriminant. Then the discussion is specialized to the ideal observer, defined as one who uses the likelihood ratio (or some monotonic transformation of it, such as its logarithm) as the discriminant function. The properties of the ideal observer are examined from first principles. Several strong constraints on the moments of the likelihood ratio or the log likelihood are derived, and it is shown that the probability density functions for these test statistics are intimately related. In particular, some surprising results are presented for the case in which the log likelihood is normally distributed under one hypothesis. To unify these considerations, a new quantity called the likelihood-generating function is defined. It is shown that all moments of both the likelihood and the log likelihood under both hypotheses can be derived from this one function. Moreover, the AUC can be expressed, to an excellent approximation, in terms of the likelihood-generating function evaluated at the origin. This expression is the leading term in an asymptotic expansion of the AUC; it is exact whenever the likelihood-generating function behaves linearly near the origin. It is also shown that the likelihood-generating function at the origin sets a lower bound on the AUC in all cases.

© 1998 Optical Society of America

OCIS Codes
(110.3000) Imaging systems : Image quality assessment
(110.4280) Imaging systems : Noise in imaging systems

History
Original Manuscript: October 30, 1997
Revised Manuscript: February 18, 1998
Manuscript Accepted: January 22, 1998
Published: June 1, 1998

Citation
Harrison H. Barrett, Craig K. Abbey, and Eric Clarkson, "Objective assessment of image quality. III. ROC metrics, ideal observers, and likelihood-generating functions," J. Opt. Soc. Am. A 15, 1520-1535 (1998)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-15-6-1520


Sort:  Author  |  Year  |  Journal  |  Reset

References

  1. H. H. Barrett, “Objective assessment of image quality: effects of quantum noise and object variability,” J. Opt. Soc. Am. A 7, 1266–1278 (1990). [CrossRef] [PubMed]
  2. H. H. Barrett, J. L. Denny, R. F. Wagner, K. J. Myers, “Objective assessment of image quality. II. Fisher information, Fourier crosstalk, and figures of merit for task performance,” J. Opt. Soc. Am. A 12, 834–852 (1995). [CrossRef]
  3. H. H. Barrett, D. W. Wilson, B. M. W. Tsui, “Noise properties of the EM algorithm I: theory,” Phys. Med. Biol. 39, 833–846 (1994). [CrossRef] [PubMed]
  4. D. W. Wilson, B. M. W. Tsui, H. H. Barrett, “Noise properties of the EM algorithm II: Monte Carlo simulations,” Phys. Med. Biol. 39, 847–872 (1994). [CrossRef] [PubMed]
  5. H. L. Van Trees, Detection, Estimation, and Modulation Theory (Wiley, New York, 1968), Vol. I.
  6. J. O. Berger, Statistical Decision Theory and Bayesian Analysis (Springer-Verlag, New York, 1985).
  7. J. L. Melsa, D. L. Cohn, Decision and Estimation Theory (McGraw-Hill, New York, 1978).
  8. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. (Academic, New York, 1990).
  9. H. H. Barrett, T. A. Gooley, K. A. Girodias, J. P. Rolland, T. A. White, J. Yao, “Linear discriminants and image quality,” Image Vision Comput. 10, 451–460 (1992). [CrossRef]
  10. H. H. Barrett, J. Yao, J. Rolland, K. J. Myers, “Model observers for assessment of image quality,” Proc. Natl. Acad. Sci. USA 90, 9758–9765 (1993). [CrossRef] [PubMed]
  11. C. E. Metz, Department of Radiology, University of Chicago, Chicago, Ill. (personal communication, 1998).
  12. R. Bracewell, The Fourier Transform and Its Applications (McGraw-Hill, New York, 1965).
  13. I. S. Gradshteyn, I. M. Ryzhik, Table of Integrals, Series and Products, 4th ed., Formula 3.954 (Academic, New York, 1965).
  14. H. H. Barrett, C. K. Abbey, “Bayesian detection of random signals on random backgrounds,” in Information Processing in Medical Imaging, Proceedings of the 15th International Conference, IPMI 97, Poultney, Vt., June 9–13, 1997, Lecture Notes in Computer Science, J. Duncan, G. Gindi, eds. (Springer-Verlag, Berlin, 1997).
  15. D. Middleton, An Introduction to Statistical Communication Theory (McGraw-Hill, New York, 1960).
  16. R. M. Swensson, D. M. Green, “On the relations between random walk models for two-choice response times,” J. Math. Psychol. 15, 282–291 (1977). [CrossRef]
  17. A. N. Shiryayev, Probability (Springer-Verlag, New York, 1984).
  18. D. M. Green, J. A. Swets, Signal Detection Theory and Psychophysics (Wiley, New York, 1966).
  19. L. Rade, B. Westergren, Beta Mathematics Handbook, 2nd ed. (CRC Press, Boca Raton, Fla., 1990).
  20. R. V. Churchill, J. W. Brown, R. F. Verkey, Complex Variables and Applications, 3rd ed. (McGraw-Hill, New York, 1974).
  21. S. Lang, Real and Functional Analysis, 3rd ed. (Springer-Verlag, New York, 1993).
  22. R. E. A. C. Paley, N. Wiener, Fourier Transforms in the Complex Domain (American Mathematical Society, New York, 1934), Vol. 19.
  23. R. Strichartz, A Guide to Distribution Theory and Fourier Transforms (CRC Press, Boca Raton, Fla., 1994).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited