OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Editor: Stephen A. Burns
  • Vol. 22, Iss. 11 — Nov. 1, 2005
  • pp: 2357–2365

Defocus morphing in real aperture images

Subhasis Chaudhuri  »View Author Affiliations


JOSA A, Vol. 22, Issue 11, pp. 2357-2365 (2005)
http://dx.doi.org/10.1364/JOSAA.22.002357


View Full Text Article

Acrobat PDF (552 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

A new concept called defocus morphing in real aperture images is introduced. View morphing is an existing example of shape-preserving image morphing based on the motion cue. It is proved that images can also be morphed based on the depth-related defocus cue. This illustrates that the morphing operation is not necessarily a geometric process alone; one can also perform a photometry-based morphing wherein the shape information is implicitly buried in the image intensity field. A theoretical understanding of the defocus morphing process is presented. It is shown mathematically that, given two observations of a three-dimensional scene for different camera parameter settings, we can obtain a virtual observation for any camera parameter setting through a simple nonlinear combination of these observations.

© 2005 Optical Society of America

OCIS Codes
(100.1830) Image processing : Deconvolution
(100.6890) Image processing : Three-dimensional image processing
(110.2990) Imaging systems : Image formation theory
(330.3790) Vision, color, and visual optics : Low vision
(330.6110) Vision, color, and visual optics : Spatial filtering

ToC Category:
Image Processing

Citation
Subhasis Chaudhuri, "Defocus morphing in real aperture images," J. Opt. Soc. Am. A 22, 2357-2365 (2005)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-22-11-2357


Sort:  Author  |  Year  |  Journal  |  Reset

References

  1. S. E. Chen and L. Williams, “View interpolation for image synthesis,” in Proceedings of SIGGRAPH 93, Anaheim, California, August 1993 (www.siggraph.com), pp. 279–288.
  2. S. M. Seitz and C. R. Dyer, “View morphing,” in Proceedings of SIGGRAPH 96, New Orleans, Lousiana, August 1996 (www.siggraph.com), pp. 21–30.
  3. T. Beier and S. Neely, “Feature-based image metamorphosis,” in Proceedings of SIGGRAPH 92, Chicago, Illinois, July 1992 (www.siggraph), pp. 35–42.
  4. S. Seitz and C. R. Dyer, “View morphing: uniquely predicting scene appearance from basis images,” in Proceedings of Image Understanding Workshop, New Orleans, Lousiana, 1997, pp. 881–887.
  5. M. Lhuillier and L. Quan, “Image interpolation by joint view triangulation,” in Proceedings of the Conference on Computer Vision and Pattern Recognition, Fort Collins, Colorado, June 1999 (IEEE Computer Society, 1999), Vol.  2, pp. 139–145.
  6. S. B. Kang, R. Szeliski, and P. Anandan, “The geometry-image representation tradeoff for rendering,” in Pro-ceedings of the International Conference on Image Processing, Vancouver, B.C. September 2000, Vol. 2, 13–16.
  7. D. Rathi, G. Agarwal, P. Kalra, and S. Banerjee, “A system for image based rendering of walk-throughs,” in Proceedings of Computer Graphics International (CGI2002), Bradford, UK, July 2002.
  8. P. Debevec, G. Borshukov, and Y. Yu, “Efficient view-dependent image-based rendering with projective texture-mapping,” in 9th Eurographics Rendering Workshop, Vienna, Austria, June 1998.
  9. S. Avidan, T. Evgeniou, A. Shashua, and T. Poggio, “Image-based view synthesis,” Artificial Intelligence (AI) Lab, AIM-1603 (MIT, 1997), CBCL paper-145.
  10. S. Avidan and A. Shashua, “Novel view synthesis in tensor space,” in Proceedings of Computer Vision and Pattern Recognition, Puerto Rico, June 1997 (IEEE Computer Society, 1997), pp. 1034–1040.
  11. P. Vazques, M. Feixas, M. Sbert, and W. Heidrich, “Image based modeling using viewpoint entropy,” in Proceedings of Computer Graphics International CGI 2002, Bradford, UK, July 2002.
  12. S. Laveau and O. D. Faugeras, “3D scene representation as a collection of images and fundamental matrices,” Tech. Report 2205 (Institut National de Recherche en Informatique et en Automatique, 1994).
  13. D. Svedberg and S. Carlsson, “Calibration, pose and novel views from single images of constrained scenes,” in Proceedings of the 11th Scandinavian Conference on Image Analysis (SCIA’99), Kangerlussuaq, Greenland, June 1999, pp. 111–117.
  14. Z. Zhang, “Image-based geometrically-correct photorealistic scene/object modeling (IBPhM): a review,” in Proceedings of the Asian Conference on Computer Vision (ACCV 98), Hong Kong, January 8–11, 1998, Vol. II, pp. 340–349.
  15. S. Vedula, S. Baker, and T. Kanade, “Spatio-temporal view interpolation,” in Proceedings of the 13th ACM Eurographics Workshop on Rendering, SaarBruecken, Germany, 2002, pp. 1–11.
  16. S. Baba, H. Saito, S. Vedula, K. M. Cheng, and T. Kanade, “Appearance-based virtual view generation for fly through in a real dynamic scene,” in Proceedings of the Joint Eurographics and IEEE TVCG Symposium on Visualization, Interlaken, Switzerland, 2000, pp. 179–188.
  17. R. A. Manning and C. R. Dyer, “Interpolating view and scene motion by dynamic view morphing,” in Proceedings of the Conference on Computer Vision and Pattern Recognition, Fort Collins, Colorado, June 1999 (IEEE Computer Society, 1999), Vol.  1, pp. 388–394.
  18. D. Cohen-Or, “Model-based view-extrapolation for interactive VR web-systems,” in Proceedings of Computer Graphics International (CGI97), Belgium, June 1997, pp. 104–112.
  19. M. Magnor, P. Ramanathan, and B. Girod, “Multi-view coding for image-based rendering using 3-D scene geometry,” IEEE Trans. Circuits Syst. Video Technol.  13, 1092–1106 (2003).
  20. D. Weiskopf, D. Kobras, and H. Ruder, “An image-based approach to special relativistic rendering,” in Proceedings of IEEE Visualization Conference October 2000 (IEEE Press, 2000), pp. 303–310.
  21. T. Ezzat and T. Poggio, “Visual speech synthesis by morphing visemes,” Int. J. Comput. Vis. ,  38, 45–57 (2000).
  22. R. J. Radke and S. Rickard, “Audio interpolation,” in Proceedings of the International Conference on Virtual, Synthetic and Entertainment Audio, Espoo, Finland, June 2002.
  23. S. Chaudhuri and A. N. Rajagopalan, Depth from Defocus: A Real Aperture Imaging Approach (Springer-Verlag, 1999).
  24. A. Kubota, K. Takahashi, K. Aizawa, and T. Chen, “All-focused light field rendering,” in Proceedings of the Eurographics Symposium on Rendering, Norrköping, Sweden, 2004, pp. 235–242.
  25. A. Kubota and K. Aizawa, “Inverse filters for reconstruction of arbitrarily focused images from two differently focused images,” in Proceedings of IEEE International Conference Image Processing, Vancouver, 2000 (IEEE Press, 2000), pp. 101–104.
  26. K. Aizawa, K. Kodama, and A. Kubota, “Producing object based special effects by fusing multiple differently focused images,” IEEE Trans. Circuits Syst. Video Technol.  10, 323–330 (2000).
  27. A. Kubota, K. Aizawa, and T. Chen, “Virtual view synthesis through linear processing without geometry,” in Proceedings of IEEE International Conference on Image Processing, Singapore, 2004 (IEEE Press, 2004), Vol. 5, pp. 3009–3012.
  28. M. Born and E. Wolf, Principles of Optics (Pergamon, 1965).
  29. A. P. Pentland, “A new sense for depth of field,” IEEE Trans. Pattern Anal. Mach. Intell.  9, 523–531 (1987).
  30. M. Subbarao, “Parallel depth recovery by changing camera parameters,” in Proceedings of Second IEEE International Conference on Computer Vision Florida, December 1988 (IEEE Computer Society, 1998), pp. 149–155.
  31. H. H. Hopkins, “The frequency response of a defocused optical system,” Proc. R. Soc. London, Ser. A  231, 91–103 (1955).
  32. L. R. Baker, “An interferometer for measuring the spatial frequency response of a lens system,” Proc. Phys. Soc. London, Sect. B  68, 871–880 (1955).
  33. A. K. Jain, Fundamentals of Digital Image Processing (Prentice-Hall, 1988).
  34. S. Bhasin and S. Chaudhuri, “Depth from defocus in presence of partial self occlusion,” in Proceedings of IEEE International Conference on Computer Vision, Vancouver, Canada, July 2001 (IEEE Press, 2001), pp. 488–493.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited