OSA's Digital Library

Applied Optics

Applied Optics

APPLICATIONS-CENTERED RESEARCH IN OPTICS

  • Editor: Joseph N. Mait
  • Vol. 49, Iss. 15 — May. 20, 2010
  • pp: 2761–2768

Fast splitting algorithm for multiframe total variation blind video deconvolution

You-Wei Wen, Chaoqiang Liu, and Andy M. Yip  »View Author Affiliations


Applied Optics, Vol. 49, Issue 15, pp. 2761-2768 (2010)
http://dx.doi.org/10.1364/AO.49.002761


View Full Text Article

Enhanced HTML    Acrobat PDF (821 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We consider the recovery of degraded videos without complete knowledge about the degradation. A spatially shift-invariant but temporally shift-varying video formation model is used. This leads to a simple multiframe degradation model that relates each original video frame with multiple observed frames and point spread functions (PSFs). We propose a variational method that simultaneously reconstructs each video frame and the associated PSFs from the corresponding observed frames. Total variation (TV) regularization is used on both the video frames and the PSFs to further reduce the ill-posedness and to better preserve edges. In order to make TV minimization practical for video sequences, we propose an efficient splitting method that generalizes some recent fast single-image TV minimization methods to the multiframe case. Both synthetic and real videos are used to show the performance of the proposed method.

© 2010 Optical Society of America

OCIS Codes
(100.3020) Image processing : Image reconstruction-restoration
(150.1135) Machine vision : Algorithms
(100.1455) Image processing : Blind deconvolution
(110.4155) Imaging systems : Multiframe image processing

ToC Category:
Image Processing

History
Original Manuscript: October 29, 2009
Revised Manuscript: March 30, 2010
Manuscript Accepted: April 1, 2010
Published: May 12, 2010

Citation
You-Wei Wen, Chaoqiang Liu, and Andy M. Yip, "Fast splitting algorithm for multiframe total variation blind video deconvolution," Appl. Opt. 49, 2761-2768 (2010)
http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-49-15-2761


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. H. Andrew and B. Hunt, Digital Image Restoration (Prentice-Hall, 1977).
  2. S. D. Babacan, R. Molina, and A. K. Katsaggelos, “Variational Bayesian blind deconvolution using a total variation prior,” IEEE Trans. Image Process. 18, 12–26 (2009). [CrossRef]
  3. T. Chan and C. Wong, “Total variation blind deconvolution,” IEEE Trans. Image Process. 7, 370–375 (1998). [CrossRef]
  4. O. Haik and Y. Yitzhaky, “Effects of image restoration on automatic acquisition of moving objects in thermal video sequences degraded by the atmosphere,” Appl. Opt. 46, 8562–8572 (2007). [CrossRef] [PubMed]
  5. H. Zhu, Y. Lu, and Q. Wu, “Blind image deconvolution subject to bandwidth and total variation constraints,” Opt. Lett. 32, 2550–2552 (2007). [CrossRef]
  6. I. Kopriva, “Approach to blind image deconvolution by multiscale subband decomposition and independent component analysis,” J. Opt. Soc. Am. A 24, 973–983 (2007). [CrossRef]
  7. D. Kundur and D. Hatzinakos, “Blind image deconvolution,” IEEE Signal. Process. Mag. 13, 43–64 (1996). [CrossRef]
  8. C. L. Matson, K. Borelli, S. Jefferies, C. C. Beckner, Jr., E. K. Hege, and M. Lloyd-Hart, “Fast and optimal multiframe blind deconvolution algorithm for high-resolution ground-based imaging of space objects,” Appl. Opt. 48, A75–A92 (2009). [CrossRef]
  9. R. Molina, J. Mateos, and A. K. Katsaggelos, “Blind deconvolution using a variational approach to parameter, image, and blur estimation,” IEEE Trans. Image Process. 15, 3715–3727(2006). [CrossRef] [PubMed]
  10. F. Sroubek and J. Flusser, “Multichannel blind iterative image restoration,” IEEE Trans. Image Process. 12, 1094–1106 (2003). [CrossRef]
  11. F. Sroubek and J. Flusser, “Multichannel blind deconvolution of spatially misaligned images,” IEEE Trans. Image Process. 14, 874–883 (2005). [CrossRef] [PubMed]
  12. Y. You and M. Kaveh, “A regularization approach to joint blur identification and image restoration,” IEEE Trans. Image Process. 5, 416–428 (1996). [CrossRef] [PubMed]
  13. A. M. Tekalp, Digital Video Processing (Prentice-Hall, 1995).
  14. T. Chan, G. Golub, and P. Mulet, “A nonlinear primal-dual method for total variation-based image restoration,” SIAM J. Sci. Comput. 20, 1964–1977 (1999). [CrossRef]
  15. T. Chan and K. Chen, “An optimization-based multilevel algorithm for total variation image denoising,” Multiscale Model. Simul. 5, 615–645 (2006). [CrossRef]
  16. A. Katsaggelos and K. Lay, “Maximum likelihood blur identification and image restoration using the EM algorithm,” IEEE Trans. Signal Process. 39, 729–733 (1991). [CrossRef]
  17. D. Krishnan, P. Lin, and X. Tai, “An efficient operator splitting method for noise removal in images,” Commun. Comput. Phys. 1, 847–858 (2006).
  18. L. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D (Amsterdam) 60, 259–268 (1992). [CrossRef]
  19. C. Vogel and M. Oman, “Iterative method for total variation denoising,” SIAM J. Sci. Comput. 17, 227–238 (1996). [CrossRef]
  20. D. Tzikas, A. Likas, and N. Galatsanos, “Variational Bayesian sparse kernel-based blind image deconvolution with student’s-t priors,” IEEE Trans. Image Process. 18, 753–764 (2009). [CrossRef] [PubMed]
  21. G. Harikumar and Y. Bresler, “Exact image deconvolution from multiple FIR blurs,” IEEE Trans. Image Process. 8, 846–862 (1999). [CrossRef]
  22. G. Harikumar and Y. Bresler, “Perfect blind restoration of images blurred by multiple filters: theory and efficient algorithms,” IEEE Trans. Image Process. 8, 202–219 (1999). [CrossRef]
  23. A. Rav-Acha and S. Peleg, “Two motion-blurred images are better than one,” Pattern Recogn. Lett. 26, 311–317 (2005). [CrossRef]
  24. Y. Huang, M. Ng, and Y. Wen, “A fast total variation minimization method for image restoration,” Multiscale Model. Simul. 7, 774–795 (2008). [CrossRef]
  25. Y. Huang, M. Ng, and Y. Wen, “A new total variation method for multiplicative noise removal,” SIAM J. Imaging Sci. 2, 20–40 (2009). [CrossRef]
  26. A. J. Patti, M. I. Sezan, and A. M. Tekalp, “Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time,” IEEE Trans. Image Process. 6, 1064–1076 (1997). [CrossRef] [PubMed]
  27. A. Chambolle, “An algorithm for total variation minimization and applications,” J. Math. Imaging Vision 20, 73 (2004). [CrossRef]
  28. M. Ng, L. Qi, Y. Yang, and Y. Huang, “On semismooth Newton’s methods for total variation minimization,” J. Math. Imaging Vision 27, 265–276 (2007). [CrossRef]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited