OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A


  • Editor: Stephen A. Burns
  • Vol. 25, Iss. 7 — Jul. 1, 2008
  • pp: 1668–1681

Scene-based nonuniformity correction and enhancement: pixel statistics and subpixel motion

Wenyi Zhao and Chao Zhang  »View Author Affiliations

JOSA A, Vol. 25, Issue 7, pp. 1668-1681 (2008)

View Full Text Article

Enhanced HTML    Acrobat PDF (1683 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



We propose a framework for scene-based nonuniformity correction (NUC) and nonuniformity correction and enhancement (NUCE) that is required for focal-plane array-like sensors to obtain clean and enhanced-quality images. The core of the proposed framework is a novel registration-based nonuniformity correction super-resolution (NUCSR) method that is bootstrapped by statistical scene-based NUC methods. Based on a comprehensive imaging model and an accurate parametric motion estimation, we are able to remove severe/structured nonuniformity and in the presence of subpixel motion to simultaneously improve image resolution. One important feature of our NUCSR method is the adoption of a parametric motion model that allows us to (1) handle many practical scenarios where parametric motions are present and (2) carry out perfect super-resolution in principle by exploring available subpixel motions. Experiments with real data demonstrate the efficiency of the proposed NUCE framework and the effectiveness of the NUCSR method.

© 2008 Optical Society of America

OCIS Codes
(040.0040) Detectors : Detectors
(100.0100) Image processing : Image processing
(110.0110) Imaging systems : Imaging systems

ToC Category:
Imaging Systems

Original Manuscript: September 24, 2007
Revised Manuscript: February 12, 2008
Manuscript Accepted: March 17, 2008
Published: June 24, 2008

Wenyi Zhao and Chao Zhang, "Scene-based nonuniformity correction and enhancement: pixel statistics and subpixel motion," J. Opt. Soc. Am. A 25, 1668-1681 (2008)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. J. Teich, “Digital infrared imaging for medicine: Recent advances in IR focal plane array imaging technology,” 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (1996), pp. 2079-2080.
  2. R. Helfrich, “Programmable compensation techniques for staring arrays,” Proc. SPIE 178, 110-121 (1979).
  3. Y. Zhao, M. Mai, R. Horowitz, A. Majumdar, J. Varesi, P. Norton, and J. Kitching, “Optomechanical uncooled infrared imaging system: Design, microfabrication, and performance,” J. Microelectromech. Syst. 11, 136-146 (2002). [CrossRef]
  4. “Studies on future broadcasting services and fundamental technologies,” Nihon Hohsoh Kyokai (NHK) Science & Technology Research Lab (STRL) Annual Report 2004 (NHK, 2005), pp. 35-149.
  5. J. Caulfield, “Next generation IR focal plane arrays and applications,” in Proceedings of the Annual Applied Imagery Pattern Recognition Workshop (2003). [CrossRef]
  6. S. Cain, E. Armstrong, and B. Yasuda, “Joint estimation of image, shift, and nonuniformities from infrared images,” in Proceedings of the Meeting of the Infrared Information Symposium (IRIS) Speciality Group on Passive Sensors (1997), pp. 121-132.
  7. D. Scribner, K. Sarkay, J. Caulfield, M. Kruer, G. Katz, and C. Gridley, “Nonuniformity correction of staring IR focal plane arrays using scene-based techniques,” Proc. SPIE 1308, 224-233 (1990). [CrossRef]
  8. A. Milton, F. Barone, and M. Kruer, “Influence of nonuniformity on infrared focal plane array performance,” Opt. Eng. 24, 855-862 (1985).
  9. S. Tzimopoulou and A. Lettington, “Scene based techniques for nonuniformity correction of infrared focal plane arrays,” Proc. SPIE 3436, 173-183 (1998).
  10. R. Hardie, M. Hayat, E. Armstrong, and B. Yasuda, “Scene-based nonuniformity correction with video sequences and registration,” Appl. Opt. 39, 1241-1250 (2000). [CrossRef]
  11. B. Ratliff, M. Hayat, and J. Tyo, “Generalized algebraic scene-based nonuniformity correction algorithm,” J. Opt. Soc. Am. A 22, 239-249 (2005). [CrossRef]
  12. W. Zhao and C. Zhang, “Efficient scene-based nonuniformity correction and enhancement,” in Proceedings of the International Conference on Image Processing (2006), pp. 2873-2876.
  13. R. Schultz and R. Stevenson, “Extraction of high resolution frames from video sequences,” IEEE Trans. Image Process. 5, 996-1011 (1996). [CrossRef] [PubMed]
  14. B. Bascle, A. Blake, and A. Zisserman, “Motion deblurring and super-resolution from an image sequence,” in Proceedings of the European Conference on Computer Vision, (1996), pp. 573-581.
  15. S. Cain, M. Hayat, and E. Armstrong, “Projection-based image registration in the presence of fixed-pattern noise,” IEEE Trans. Image Process. 10, 1860-1872 (2001). [CrossRef]
  16. E. Armstrong, M. Hayat, R. Hardie, S. Torres, and B. Yasuda, “Non-uniformity correction for improved registration and high-resolution image reconstruction in IR imagery,” Proc. SPIE 3808, 150-161 (1999). [CrossRef]
  17. J. Harris and Y. Chiang, “Nonuniformity correction of infrared image sequences using the constant-statistics constraint,” IEEE Trans. Image Process. 8, 1148-1151 (1999). [CrossRef]
  18. M. Hayat, S. Torres, E. Armstrong, S. Cain, and B. Yasuda, “Statistical algorithm for nonuniformity correction in focal-plane arrays,” Appl. Opt. 38, 772-780 (1999). [CrossRef]
  19. S. Torres and M. Hayat, “Kalman filtering for adaptive nonuniformity correction in infrared focal-plane arrays,” J. Opt. Soc. Am. A 20, 470-480 (2003). [CrossRef]
  20. P. Narendra and N. Foss, “Shutterless fixed pattern noise correction for infrared imaging array,” Proc. SPIE 282, 44-51 (1981).
  21. B. Narayanan, R. Hardie, and R. Muse, “Scene-based nonuniformity correction technique that exploits knowledge of the focal-plane array readout architectures,” Appl. Opt. 44, 3482-3491 (2005). [CrossRef] [PubMed]
  22. W. O'Neil, “Dither image scanner with compensation for individual detector response and gain correction,” U. S. patent 5,514,865 (May 7, 1996).
  23. B. Ratliff, M. Hayat, and R. Hardie, “An algebraic algorithm for nonuniformity correction in focal-plane arrays,” J. Opt. Soc. Am. A 19, 1737-1747 (2002). [CrossRef]
  24. B. Ratliff, M. Hayat, and J. Tyo, “Radiometrically accurate scene-based nonuniformity correction for array sensors,” J. Opt. Soc. Am. A 20, 1890-1899 (2003). [CrossRef]
  25. R. Hardie, K. Barnard, J. Bognar, E. Armstrong, and R. Watson, “High-resolution image reconstruction from a sequence of rotated and translated frames and its application to an infrared imaging system,” Opt. Eng. 37, 247-260 (1998). [CrossRef]
  26. J. Gillette, T. Stadtmiller, and R. Hardie, “Aliasing reduction in staring infrared imagers utilizing subpixel techniques,” Opt. Eng. 34, 3130-3137 (1995). [CrossRef]
  27. W. Zhao and H. Sawhney, “Is optical flow based super-resolution feasible?” in Proceedings of the European Conference on Computer Vision (2002).
  28. G. Wolberg, Digital Image Warping (IEEE Computer Society Press, 1990).
  29. M. Irani and S. Peleg, “Motion analysis for image enhancement: Resolution, occlusion, and transparency,” J. Visual Commun. Image Represent 4, 324-335 (1993). [CrossRef]
  30. R. Young, An Introduction to Nonharmonic Fourier Series (Academic, 1980).
  31. R. Y. Tsai, and T. S. Huang, “Multiframe image restoration and registration” in Advances in Computer Vision and Image Processing (JAI Press Inc., 1984).
  32. A. Patti, M. Sezan, and M. Tekalp, “Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time,” IEEE Trans. Image Process. 6, pp. 1064-1076 (1997). [CrossRef] [PubMed]
  33. P. Marziliano and M. Vetterlli, “Reconstruction of irregularly sampled discrete-time bandlimited signals,” IEEE Trans. Image Process. 3462-3471 (1999).
  34. M. Elad and A. Feuer, “Restoration of a single superresolution image from several blurred, noisy and undersampled measured images,” IEEE Trans. Image Process. 6, 1646-1658 (1997). [CrossRef] [PubMed]
  35. J. Bergen, P. Anadan, K. Hanna, and R. Hingorani, “Hierarchical model-based motion estimation,” in Proceedings of the European Conference on Computer Vision (1992) pp. 237-252.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited