OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Editor: Stephen A. Burns
  • Vol. 22, Iss. 11 — Nov. 1, 2005
  • pp: 2357–2365

Defocus morphing in real aperture images

Subhasis Chaudhuri  »View Author Affiliations


JOSA A, Vol. 22, Issue 11, pp. 2357-2365 (2005)
http://dx.doi.org/10.1364/JOSAA.22.002357


View Full Text Article

Enhanced HTML    Acrobat PDF (552 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

A new concept called defocus morphing in real aperture images is introduced. View morphing is an existing example of shape-preserving image morphing based on the motion cue. It is proved that images can also be morphed based on the depth-related defocus cue. This illustrates that the morphing operation is not necessarily a geometric process alone; one can also perform a photometry-based morphing wherein the shape information is implicitly buried in the image intensity field. A theoretical understanding of the defocus morphing process is presented. It is shown mathematically that, given two observations of a three-dimensional scene for different camera parameter settings, we can obtain a virtual observation for any camera parameter setting through a simple nonlinear combination of these observations.

© 2005 Optical Society of America

OCIS Codes
(100.1830) Image processing : Deconvolution
(100.6890) Image processing : Three-dimensional image processing
(110.2990) Imaging systems : Image formation theory
(330.3790) Vision, color, and visual optics : Low vision
(330.6110) Vision, color, and visual optics : Spatial filtering

ToC Category:
Image Processing

History
Original Manuscript: December 15, 2004
Revised Manuscript: March 30, 2005
Manuscript Accepted: March 30, 2005
Published: November 1, 2005

Citation
Subhasis Chaudhuri, "Defocus morphing in real aperture images," J. Opt. Soc. Am. A 22, 2357-2365 (2005)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-22-11-2357


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. S. E. Chen, L. Williams, “View interpolation for image synthesis,” in Proceedings of SIGGRAPH 93, Anaheim, California, August 1993 (www.siggraph.com), pp. 279–288.
  2. S. M. Seitz, C. R. Dyer, “View morphing,” in Proceedings of SIGGRAPH 96, New Orleans, Lousiana, August 1996 (www.siggraph.com), pp. 21–30.
  3. T. Beier, S. Neely, “Feature-based image metamorphosis,” in Proceedings of SIGGRAPH 92, Chicago, Illinois, July 1992 (www.siggraph), pp. 35–42.
  4. S. Seitz, C. R. Dyer, “View morphing: uniquely predicting scene appearance from basis images,” in Proceedings of Image Understanding Workshop, New Orleans, Lousiana, 1997, pp. 881–887.
  5. M. Lhuillier, L. Quan, “Image interpolation by joint view triangulation,” in Proceedings of the Conference on Computer Vision and Pattern Recognition, Fort Collins, Colorado, June 1999 (IEEE Computer Society, 1999), Vol. 2, pp. 139–145.
  6. S. B. Kang, R. Szeliski, P. Anandan, “The geometry-image representation tradeoff for rendering,” in Pro- ceedings of the International Conference on Image Processing, Vancouver, B.C. September 2000, Vol. 2, 13–16.
  7. D. Rathi, G. Agarwal, P. Kalra, S. Banerjee, “A system for image based rendering of walk-throughs,” in Proceedings of Computer Graphics International (CGI2002), Bradford, UK, July 2002.
  8. P. Debevec, G. Borshukov, Y. Yu, “Efficient view-dependent image-based rendering with projective texture-mapping,” in 9th Eurographics Rendering Workshop, Vienna, Austria, June 1998.
  9. S. Avidan, T. Evgeniou, A. Shashua, T. Poggio, “Image-based view synthesis,” Artificial Intelligence (AI) Lab, AIM-1603 (MIT, 1997), CBCL paper-145.
  10. S. Avidan, A. Shashua, “Novel view synthesis in tensor space,” in Proceedings of Computer Vision and Pattern Recognition, Puerto Rico, June 1997 (IEEE Computer Society, 1997), pp. 1034–1040.
  11. P. Vazques, M. Feixas, M. Sbert, W. Heidrich, “Image based modeling using viewpoint entropy,” in Proceedings of Computer Graphics International CGI 2002, Bradford, UK, July 2002.
  12. S. Laveau, O. D. Faugeras, “3D scene representation as a collection of images and fundamental matrices,” Tech. Report 2205 (Institut National de Recherche en Informatique et en Automatique, 1994).
  13. D. Svedberg, S. Carlsson, “Calibration, pose and novel views from single images of constrained scenes,” in Proceedings of the 11th Scandinavian Conference on Image Analysis (SCIA’99), Kangerlussuaq, Greenland, June 1999, pp. 111–117.
  14. Z. Zhang, “Image-based geometrically-correct photorealistic scene/object modeling (IBPhM): a review,” in Proceedings of the Asian Conference on Computer Vision (ACCV 98), Hong Kong, January 8–11, 1998, Vol. II, pp. 340–349.
  15. S. Vedula, S. Baker, T. Kanade, “Spatio-temporal view interpolation,” in Proceedings of the 13th ACM Eurographics Workshop on Rendering, SaarBruecken, Germany, 2002, pp. 1–11.
  16. S. Baba, H. Saito, S. Vedula, K. M. Cheng, T. Kanade, “Appearance-based virtual view generation for fly through in a real dynamic scene,” in Proceedings of the Joint Eurographics and IEEE TVCG Symposium on Visualization, Interlaken, Switzerland, 2000, pp. 179–188.
  17. R. A. Manning, C. R. Dyer, “Interpolating view and scene motion by dynamic view morphing,” in Proceedings of the Conference on Computer Vision and Pattern Recognition, Fort Collins, Colorado, June 1999 (IEEE Computer Society, 1999), Vol. 1, pp. 388–394.
  18. D. Cohen-Or, “Model-based view-extrapolation for interactive VR web-systems,” in Proceedings of Computer Graphics International (CGI97), Belgium, June 1997, pp. 104–112.
  19. M. Magnor, P. Ramanathan, B. Girod, “Multi-view coding for image-based rendering using 3-D scene geometry,” IEEE Trans. Circuits Syst. Video Technol. 13, 1092–1106 (2003). [CrossRef]
  20. D. Weiskopf, D. Kobras, H. Ruder, “An image-based approach to special relativistic rendering,” in Proceedings of IEEE Visualization Conference October 2000 (IEEE Press, 2000), pp. 303–310.
  21. T. Ezzat, T. Poggio, “Visual speech synthesis by morphing visemes,” Int. J. Comput. Vis., 38, 45–57 (2000). [CrossRef]
  22. R. J. Radke, S. Rickard, “Audio interpolation,” in Proceedings of the International Conference on Virtual, Synthetic and Entertainment Audio, Espoo, Finland, June 2002.
  23. S. Chaudhuri, A. N. Rajagopalan, Depth from Defocus: A Real Aperture Imaging Approach (Springer-Verlag, 1999).
  24. A. Kubota, K. Takahashi, K. Aizawa, T. Chen, “All-focused light field rendering,” in Proceedings of the Eurographics Symposium on Rendering, Norrköping, Sweden, 2004, pp. 235–242.
  25. A. Kubota, K. Aizawa, “Inverse filters for reconstruction of arbitrarily focused images from two differently focused images,” in Proceedings of IEEE International Conference Image Processing, Vancouver, 2000 (IEEE Press, 2000), pp. 101–104.
  26. K. Aizawa, K. Kodama, A. Kubota, “Producing object based special effects by fusing multiple differently focused images,” IEEE Trans. Circuits Syst. Video Technol. 10, 323–330 (2000). [CrossRef]
  27. A. Kubota, K. Aizawa, T. Chen, “Virtual view synthesis through linear processing without geometry,” in Proceedings of IEEE International Conference on Image Processing, Singapore, 2004 (IEEE Press, 2004), Vol. 5, pp. 3009–3012.
  28. M. Born, E. Wolf, Principles of Optics (Pergamon, 1965).
  29. A. P. Pentland, “A new sense for depth of field,” IEEE Trans. Pattern Anal. Mach. Intell. 9, 523–531 (1987). [CrossRef] [PubMed]
  30. M. Subbarao, “Parallel depth recovery by changing camera parameters,” in Proceedings of Second IEEE International Conference on Computer Vision Florida, December 1988 (IEEE Computer Society, 1998), pp. 149–155.
  31. H. H. Hopkins, “The frequency response of a defocused optical system,” Proc. R. Soc. London, Ser. A 231, 91–103 (1955). [CrossRef]
  32. L. R. Baker, “An interferometer for measuring the spatial frequency response of a lens system,” Proc. Phys. Soc. London, Sect. B 68, 871–880 (1955). [CrossRef]
  33. A. K. Jain, Fundamentals of Digital Image Processing (Prentice-Hall, 1988).
  34. S. Bhasin, S. Chaudhuri, “Depth from defocus in presence of partial self occlusion,” in Proceedings of IEEE International Conference on Computer Vision, Vancouver, Canada, July 2001 (IEEE Press, 2001), pp. 488–493.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited