OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 17, Iss. 2 — Feb. 1, 2000
  • pp: 206–217

Visual signal detection in structured backgrounds. IV. Figures of merit for model performance in multiple-alternative forced-choice detection tasks with correlated responses

Miguel P. Eckstein, Craig K. Abbey, and François O. Bochud  »View Author Affiliations


JOSA A, Vol. 17, Issue 2, pp. 206-217 (2000)
http://dx.doi.org/10.1364/JOSAA.17.000206


View Full Text Article

Enhanced HTML    Acrobat PDF (839 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Many investigators are currently developing models to predict human performance in detecting a signal embedded in complex backgrounds. A common figure of merit for model performance is d, an index of detectability that can be mathematically related to the proportion correct (Pc) when the responses of the model are Gaussian distributed and statistically independent. However, in many multiple-alternative forced-choice (MAFC) detection tasks, the target appears in one of M different locations within an image. If the image contains slow spatially varying luminance changes (low-pass noise), the pixel luminance values at the possible signal locations are correlated and therefore the model/human responses to the different locations might also be correlated. We investigate the effect of response correlations on model performance and compare different figures of merit for these conditions. Our results show that use of the standard d index of detectability assuming statistical independence can lead to erroneous underestimates of Pc and misleading comparisons of models. We introduce a novel figure of merit dr that takes into account response correlations and can be used to accurately estimate Pc. Furthermore, we show that dr can be readily related to the standard index of detectability d by dr=d/1-r, where r is the correlation between the responses in any MAFC detection task. We illustrate the use of the theory by computing figures of merit for two linear models detecting a signal in one of four locations within medical image backgrounds.

© 2000 Optical Society of America

OCIS Codes
(110.3000) Imaging systems : Image quality assessment
(330.1880) Vision, color, and visual optics : Detection
(330.4060) Vision, color, and visual optics : Vision modeling
(330.7310) Vision, color, and visual optics : Vision

History
Original Manuscript: January 4, 1999
Revised Manuscript: June 2, 1999
Manuscript Accepted: June 8, 1999
Published: February 1, 2000

Citation
Miguel P. Eckstein, Craig K. Abbey, and François O. Bochud, "Visual signal detection in structured backgrounds. IV. Figures of merit for model performance in multiple-alternative forced-choice detection tasks with correlated responses," J. Opt. Soc. Am. A 17, 206-217 (2000)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-17-2-206


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. R. G. Swensson, P. F. Judy, “Detection of noisy visual targets: model for the effects of spatial uncertainty and signal to noise ratio,” Percept. Psychophys. 29, 521–534 (1981). [CrossRef] [PubMed]
  2. A. E. Burgess, R. B. Wagner, R. J. Jennings, H. B. Barlow, “Efficiency of human visual signal discrimination,” Science 214, 93–94 (1981). [CrossRef] [PubMed]
  3. A. E. Burgess, H. Ghandeharian, “Visual signal detection. II. Signal location identification,” J. Opt. Soc. Am. A 1, 900–905 (1984). [CrossRef] [PubMed]
  4. K. J. Myers, H. H. Barrett, M. C. Borgstrom, D. D. Patton, G. W. Seeley, “Effect of noise correlation on detectability of disk signals in medical imaging,” J. Opt. Soc. Am. A 2, 1752–1759 (1985). [CrossRef] [PubMed]
  5. J. P. Rolland, H. H. Barrett, “Effect of random inhomogeneity on observer detection performance,” J. Opt. Soc. Am. A 9, 649–658 (1992). [CrossRef] [PubMed]
  6. M. P. Eckstein, J. S. Whiting, J. P. Thomas, “Role of knowledge in human visual temporal integration in spatiotemporal noise,” J. Opt. Soc. Am. A 13, 1960–1968 (1996). [CrossRef]
  7. D. L. Wilson, K. N. Jabri, P. Xue, R. Aufrichtig, “Perceived noise versus display noise in temporally filtered image sequences,” J. Electron. Imaging 5, 490–495 (1996). [CrossRef]
  8. A. E. Burgess, X. Li, C. K. Abbey, “Visual signal detectability with two noise components: anomalous masking effects,” J. Opt. Soc. Am. A 14, 2420–2442 (1997). [CrossRef]
  9. A. J. Ahumada, B. L. Beard, “Object detection in a noisy Scene,” in Human Vision, Visual Processing, and Digital Display VII, B. Rogowitz, J. Allebach, eds., Proc. SPIE2657, 190–199 (1996).
  10. A. J. Ahumada, A. B. Watson, A. M. Rohaly, “Models of human image discrimination predict object detection in natural backgrounds,” in Human Vision, Visual Processing, and Digital Display VI, B. Rogowitz, J. Allebach, eds., Proc. SPIE2411, 355–362 (1995). [CrossRef]
  11. A. M. Rohaly, A. J. Ahumada, A. B. Watson, “Object detection in natural backgrounds predicted by discrimination performance and models,” Vision Res. 37, 3225–3235 (1997). [CrossRef]
  12. A. B. Watson, M. Taylor, R. Borthwick, “Image quality and entropy masking,” in Human Vision, Visual Processing, and Digital Display VIII, B. E. Rogowitz, T. N. Pappas, eds., Proc. SPIE3016, 2–12 (1997).
  13. M. P. Eckstein, A. J. Ahumada, A. B. Watson, “Image discrimination models predict signal detection in natural medical image backgrounds,” in Human Vision, Visual Processing, and Digital Display VIII, B. E. Rogowitz, T. N. Pappas, eds., Proc. SPIE3016, 44–56 (1997).
  14. M. P. Eckstein, J. S. Whiting, “Visual signal detection in structured backgrounds. I. Effect of number of possible locations and signal contrast,” J. Opt. Soc. Am. A 13, 1777–1787 (1996). [CrossRef]
  15. M. P. Eckstein, A. J. Ahumada, A. B. Watson, “Visual signal detection in structured backgrounds. II. Effects of contrast gain control, background variations, and white noise,” J. Opt. Soc. Am. A 14, 2406–2419 (1997). [CrossRef]
  16. F. O. Bochud, C. K. Abbey, M. P. Eckstein, “Visual signal detection in structured backgrounds. III. Calculation of figures of merit for model observers in statistically nonstationary backgrounds,” J. Opt. Soc. Am. A 17, 193–205 (2000). [CrossRef]
  17. F. O. Bochud, F. R. Verdun, J. F. Valley, C. Hessler, R. Moeckli, “Importance of anatomical noise in mammography,” in Image Perception, H. Kundel, ed., Proc. SPIE3036, 74–80 (1997).
  18. F. O. Bochud, C. K. Abbey, M. P. Eckstein, “Further investigation of the effect of phase spectrum on visual detection in structured backgrounds,” in Image Perception, E. Krupinski, ed., Proc. SPIE3663, 273–281 (1999).
  19. R. F. Wagner, K. E. Weaver, “An assortment of image quality indices for radiographic film-screen combinations—can they be resolved?” in Application of Optical Instrumentation in Medicine I, P. L. Carson, W. H. Hendee, W. C. Zarnstorff, eds., Proc. SPIE35, 83–94 (1972). [CrossRef]
  20. M. S. Chesters, “Human visual perception and ROC methodology in medical imaging,” Phys. Med. Biol. 37, 1433–1476 (1992). [CrossRef] [PubMed]
  21. A. E. Burgess, “Comparison of receiver operating characteristic and forced choice observer performance measurement methods,” Med. Phys. 22, 643–655 (1995). [CrossRef] [PubMed]
  22. A. E. Burgess, “Statistically defined backgrounds: performance of a modified nonprewhitening matched filter model,” J. Opt. Soc. Am. A 11, 1237–1242 (1994). [CrossRef]
  23. K. Myers, H. H. Barrett, “Addition of a channel mechanism to the ideal observer model,” J. Opt. Soc. Am. A 4, 2447–2457 (1987). [CrossRef] [PubMed]
  24. J. Yao, H. H. Barrett, “Predicting human performance by a channelized Hotelling observer model,” in Mathematical Methods in Medical Imaging, Proc. SPIE1768, 161–168 (1992). [CrossRef]
  25. H. H. Barrett, J. Yao, J. P. Rolland, K. J. Myers, “Model observers for assessment of image quality,” Proc. Natl. Acad. Sci. USA 90, 9758–9765 (1993). [CrossRef] [PubMed]
  26. C. K. Abbey, H. H. Barrett, “Linear iterative reconstruction algorithms: study of observer performance,” in Proceedings of the 14th International Conference on Information Processing in Medical Imaging, Y. Bizais, C. Barillot, R. Di Paola, eds. (Kluwer Academic, Dordrecht, The Netherlands, 1995), pp. 65–76.
  27. C. K. Abbey, H. H. Barrett, D. W. Wilson, “Observer signal to noise ratios for the ML-EM algorithm,” in Image Perception, H. Kundel, ed., Proc. SPIE2712, 47–58 (1996).
  28. C. K. Abbey, H. H. Barrett, M. P. Eckstein, “Practical issues and methodology in assessment of image quality using model observers,” in The Physics of Medical Imaging, H. Roerhig, ed., Proc. SPIE3032, 182–194 (1997).
  29. A slight modification of this formula applies if the response variances differ.
  30. N. Brady, “Spatial scale interactions and image statistics,” Perception 26, 1089–1100 (1997). [CrossRef] [PubMed]
  31. A. Van der Schaaf, J. H. Van Hateren, “Modelling the power spectra of natural images: statistics and information,” Vision Res. 36, 2759–2770 (1996). [CrossRef] [PubMed]
  32. D. M. Green, J. A. Swets, Signal Detection Theory and Psychophysics (Wiley, New York, 1966).
  33. In some cases a source of internal noise is added to the model observer’s internal response to degrade its performance to human performance levels. In these cases the internal response of the observer is a composite of the scalar product between the template, the image, and the internal noise.
  34. M. Ishida, K. Doi, L. N. Loo, C. E. Metz, J. L. Lehr, “Digital image processing: effect of detectability of simu-lated low-contrast radiographic patterns,” Radiology 150, 569–575 (1984). [PubMed]
  35. M. P. Eckstein, C. A. Abbey, J. S. Whiting, “Human vs model observers in anatomic backgrounds,” in Image Perception, H. Kundel, ed., Proc. SPIE3340, 15–26 (1998).
  36. J. Palmer, “Set-size effects in visual search: the effect of attention is independent of the stimulus for simple tasks,” Vision Res. 34, 1703–1721 (1994). [CrossRef] [PubMed]
  37. M. L. Shaw, “Identifying attentional and decision making components in information processing,” in Attention and Performance VII, R. S. Nickerson, ed. (Erlbaum, Hillsdale, N.J., 1980), pp. 277–296.
  38. P. S. Bennett, P. D. Jaye, “Letter localization, not discrimination, is constrained by attention,” Can. J. Exp. Psychol. 49, 460–504 (1995). [CrossRef] [PubMed]
  39. M. P. Eckstein, “The lower efficiency for conjunctions is due to noise and not serial attentional processing,” Psychol. Sci. 2, 111–118 (1998). [CrossRef]
  40. W. A. Wickelgren, “Unidimensional strength theory and component analysis of noise in absolute and comparative judgments,” J. Math. Psychol. 5, 102–122 (1968). [CrossRef]
  41. H. H. Barrett, C. K. Abbey, B. Gallas, M. P. Eckstein, “Stabilized estimates of Hotelling-observer detection performance in patient structured noise,” in Image Perception, H. Kundel, ed., Proc. SPIE3340, 27–43 (1998).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited