Real scene capturing using spherical single-element lens camera and improved restoration algorithm for radially variant blur

doi:10.1364/OE.20.027569

Real scene capturing using spherical single-element lens camera and improved restoration algorithm for radially variant blur

Yupeng Zhang, Lev G. Zimin, Jing Ji, Satoshi Ikezawa, and Toshitsugu Ueda »View Author Affiliations

Optics Express, Vol. 20, Issue 25, pp. 27569-27588 (2012)
http://dx.doi.org/10.1364/OE.20.027569

View Full Text Article

Enhanced HTML Acrobat PDF (6901 KB)

Journal Search
Article Lookup

Article Tools

Citations

Alert me when this article is cited
Export Citation/Save

Abstract
Article Info
References (15)
Cited By
Figures (14)
Metrics
Related Content

Abstract

A camera module employing spherical single-element lens imaging system (SSLIS) is introduced in this study. This type of imaging system can be used in compact digital cameras or mobile phone cameras, and it provides the advantages of simple design, reduced device bulkiness, and reduced manufacturing costs. When compared with conventional camera modules, our system produces radially variant blurred images, which can be satisfactorily restored by means of a polar domain deconvolution algorithm proposed in our previous study. In this study, we demonstrate an improved version of this algorithm that enables full-field-of-view (FOV) image restoration instead of the partial FOV restoration obtained via our previous algorithm. This improvement is realized by interpolating the upper and arc-shaped boundaries of the panoramic polar image such that the ringing artifacts around the center and four boundaries of the restored Cartesian image are greatly suppressed. The effectiveness of the improved algorithm is verified by image restoration of both computer simulated images and real-world scenes captured by the spherical single lens camera module. The quality of the restored image depends on the overall sparsity of all the point spread function (PSF) block Toeplitz with circulant blocks (BTCB) matrices used to restore a radially blurred image.

OCIS Codes
(040.1490) Detectors : Cameras
(100.1830) Image processing : Deconvolution
(100.3020) Image processing : Image reconstruction-restoration
(110.5200) Imaging systems : Photography
(220.1000) Optical design and fabrication : Aberration compensation
(220.3620) Optical design and fabrication : Lens system design

ToC Category:
Imaging Systems

History
Original Manuscript: September 26, 2012
Revised Manuscript: November 11, 2012
Manuscript Accepted: November 15, 2012
Published: November 28, 2012

Citation
Yupeng Zhang, Lev G. Zimin, Jing Ji, Satoshi Ikezawa, and Toshitsugu Ueda, "Real scene capturing using spherical single-element lens camera and improved restoration algorithm for radially variant blur," Opt. Express 20, 27569-27588 (2012)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-20-25-27569

Sort: Author | Year | Journal | Reset

References

Y. Koike, H. Hidaka, and Y. Ohtsuka, “Plastic axial gradient-index lens,” Appl. Opt.24(24), 4321–4325 (1985). [CrossRef] [PubMed]
D. T. Moore, “Gradient-index optics: a review,” Appl. Opt.19(7), 1035–1038 (1980). [CrossRef] [PubMed]
S. Kuiper and B. H. W. Hendriks, “Variable-focus liquid lens for miniature cameras,” Appl. Phys. Lett.85(7), 1128–1130 (2004). [CrossRef]
W. Wang, J. Fang, and K. Varahramyan, “Compact variable-focusing microlens with integrated thermal actuator and sensor,” IEEE Photon. Technol. Lett.17(12), 2643–2645 (2005). [CrossRef]
Y. Zhang and T. Ueda, “Field-dependent distortion coefficient and backward mapping for distortion correction of singlet lens cameras,” IEEE J. Trans. Elect. Electron. Eng.5(2), 203–210 (2010). [CrossRef]
Y. Zhang and T. Ueda, “Design of a singlet lens and the corresponding aberration correction approaches for cell phone camera,” IEEE J. Trans. Elect. Electron. Eng.5(4), 474–485 (2010). [CrossRef]
Y. Zhang and T. Ueda, “Deblur of radially variant blurred image for single lens system,” IEEE J. Trans. Elect. Electron. Eng.6(S1), S7–S16 (2011). [CrossRef]
Y. Zhang, I. Minema, and T. Ueda, “Analysis of radially restored images for spherical single lens cellphone camera,” IEEE Sens. J.11(11), 2834–2844 (2011). [CrossRef]
H. C. Andrews and B. R. Hunt, Digital Image Restoration (Prentice-Hall, 1977), Chap.6,7,8 and 9.
M. R. Banham and A. K. Katsaggelos, “Digital image restoration,” IEEE Signal Process. Mag.14(2), 24–41 (1997). [CrossRef]
R. L. Lagendijk, J. Biemond, and D. E. Boekee, “Regularized iterative image restoration with ringing reduction,” IEEE Trans. Acoust. Speech36(12), 1874–1888 (1988). [CrossRef]
S. J. Reeves, “Fast image restoration without boundary artifacts,” IEEE Trans. Image Process.14(10), 1448–1453 (2005). [CrossRef] [PubMed]
M. Hanke and J. Nagy, “Toeplitz approximate inverse preconditioner for banded Toeplitz matrices,” Numer. Alg.7(2), 183–199 (1994). [CrossRef]
J. G. Nagy, R. J. Plemmons, and T. C. Torgersen, “Iterative image restoration using approximate inverse preconditioning,” IEEE Trans. Image Process.5(7), 1151–1162 (1996). [CrossRef] [PubMed]
R. H. Chan, J. G. Nagy, and R. J. Plemmons, “FFT-based preconditioners for Toeplitz-Block least squares problems,” SIAM J. Numer. Anal.30(6), 1740–1768 (1993). [CrossRef]

Banham, M. R.
Biemond, J.
Boekee, D. E.
Chan, R. H.
Fang, J.
Hanke, M.
Hendriks, B. H. W.
Hidaka, H.
Katsaggelos, A. K.
Koike, Y.
Kuiper, S.
Lagendijk, R. L.
Minema, I.
Moore, D. T.
Nagy, J.
Nagy, J. G.
Ohtsuka, Y.
Plemmons, R. J.
Reeves, S. J.
Torgersen, T. C.
Ueda, T.
Varahramyan, K.
Wang, W.
Zhang, Y.

Appl. Opt.

Appl. Phys. Lett.

S. Kuiper and B. H. W. Hendriks, “Variable-focus liquid lens for miniature cameras,” Appl. Phys. Lett.85(7), 1128–1130 (2004). [CrossRef]

IEEE J. Trans. Elect. Electron. Eng.

Y. Zhang and T. Ueda, “Field-dependent distortion coefficient and backward mapping for distortion correction of singlet lens cameras,” IEEE J. Trans. Elect. Electron. Eng.5(2), 203–210 (2010). [CrossRef]
Y. Zhang and T. Ueda, “Design of a singlet lens and the corresponding aberration correction approaches for cell phone camera,” IEEE J. Trans. Elect. Electron. Eng.5(4), 474–485 (2010). [CrossRef]
Y. Zhang and T. Ueda, “Deblur of radially variant blurred image for single lens system,” IEEE J. Trans. Elect. Electron. Eng.6(S1), S7–S16 (2011). [CrossRef]

IEEE Photon. Technol. Lett.

W. Wang, J. Fang, and K. Varahramyan, “Compact variable-focusing microlens with integrated thermal actuator and sensor,” IEEE Photon. Technol. Lett.17(12), 2643–2645 (2005). [CrossRef]

IEEE Sens. J.

Y. Zhang, I. Minema, and T. Ueda, “Analysis of radially restored images for spherical single lens cellphone camera,” IEEE Sens. J.11(11), 2834–2844 (2011). [CrossRef]

IEEE Signal Process. Mag.

M. R. Banham and A. K. Katsaggelos, “Digital image restoration,” IEEE Signal Process. Mag.14(2), 24–41 (1997). [CrossRef]

IEEE Trans. Acoust. Speech

R. L. Lagendijk, J. Biemond, and D. E. Boekee, “Regularized iterative image restoration with ringing reduction,” IEEE Trans. Acoust. Speech36(12), 1874–1888 (1988). [CrossRef]

IEEE Trans. Image Process.

S. J. Reeves, “Fast image restoration without boundary artifacts,” IEEE Trans. Image Process.14(10), 1448–1453 (2005). [CrossRef] [PubMed]
J. G. Nagy, R. J. Plemmons, and T. C. Torgersen, “Iterative image restoration using approximate inverse preconditioning,” IEEE Trans. Image Process.5(7), 1151–1162 (1996). [CrossRef] [PubMed]

Numer. Alg.

M. Hanke and J. Nagy, “Toeplitz approximate inverse preconditioner for banded Toeplitz matrices,” Numer. Alg.7(2), 183–199 (1994). [CrossRef]

SIAM J. Numer. Anal.

R. H. Chan, J. G. Nagy, and R. J. Plemmons, “FFT-based preconditioners for Toeplitz-Block least squares problems,” SIAM J. Numer. Anal.30(6), 1740–1768 (1993). [CrossRef]

Other

H. C. Andrews and B. R. Hunt, Digital Image Restoration (Prentice-Hall, 1977), Chap.6,7,8 and 9.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Click here to see a list of articles that cite this paper