Reconstruction of hidden 3D shapes using diffuse reflections

doi:10.1364/OE.20.019096

Reconstruction of hidden 3D shapes using diffuse reflections

Otkrist Gupta, Thomas Willwacher, Andreas Velten, Ashok Veeraraghavan, and Ramesh Raskar »View Author Affiliations

Optics Express, Vol. 20, Issue 17, pp. 19096-19108 (2012)
http://dx.doi.org/10.1364/OE.20.019096

View Full Text Article

Enhanced HTML Acrobat PDF (4045 KB)

Journal Search
Article Lookup

Article Tools

Citations

Alert me when this article is cited
Export Citation/Save

Abstract
Article Info
References (13)
Cited By
Figures (9)
Metrics
Related Content

Abstract

We analyze multi-bounce propagation of light in an unknown hidden volume and demonstrate that the reflected light contains sufficient information to recover the 3D structure of the hidden scene. We formulate the forward and inverse theory of secondary scattering using ideas from energy front propagation and tomography. We show that using Fresnel approximation greatly simplifies this problem and the inversion can be achieved via a backpropagation process. We study the invertibility, uniqueness and choices of space-time-angle dimensions using synthetic examples. We show that a 2D streak camera can be used to discover and reconstruct hidden geometry. Using a 1D high speed time of flight camera, we show that our method can be used recover 3D shapes of objects “around the corner”.

OCIS Codes
(110.0110) Imaging systems : Imaging systems
(110.1758) Imaging systems : Computational imaging

ToC Category:
Imaging Systems

History
Original Manuscript: March 30, 2012
Revised Manuscript: July 5, 2012
Manuscript Accepted: July 11, 2012
Published: August 6, 2012

Virtual Issues
Vol. 7, Iss. 10 Virtual Journal for Biomedical Optics

Citation
Otkrist Gupta, Thomas Willwacher, Andreas Velten, Ashok Veeraraghavan, and Ramesh Raskar, "Reconstruction of hidden 3D shapes using diffuse reflections," Opt. Express 20, 19096-19108 (2012)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-20-17-19096

Sort: Author | Year | Journal | Reset

References

P. Sen, B. Chen, G. Garg, S. R. Marschner, M. Horowitz, M. Levoy, and H. P. A. Lensch, “Dual photography,” ACM Trans. Graphics24(2), 745–755 (2005). [CrossRef]
S. M. Seitz, Y. Matsushita, and K. N. Kutulakos, “A theory of inverse light transport,” in Proc. of IEEE ICCV (2005), Vol. 2, pp. 1440–1447.
S. K. Nayar, G. Krishnan, M. D. Grossberg, and R. Raskar, “Fast separation of direct and global components of a scene using high frequency illumination,” ACM Trans. Graphics25, 935–944 (2006). [CrossRef]
A. Kirmani, T. Hutchison, J. Davis, and R. Raskar, “Looking around the corner using transient imaging,” in Proc. of IEEE ICCV (2009), pp. 159–166.
R. Pandharkar, A. Velten, A. Bardagjy, M. G. Bawendi, and R. Raskar, “Estimating motion and size of moving non-line-of-sight objects in cluttered environments,” in Proc. of CVPR (2011), pp. 265–272. [CrossRef]
S. Liu, T. Ng, and Y. Matsushita, “Shape from second-bounce of light transport,” in Proc. of ECCV (2010), pp. 280–293.
R. Raskar and J. Davis, “5D time-light transport matrix: What can we reason about scene properties,” MIT Technical Report (2008), http://hdl.handle.net/1721.1/67888 .
A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and R. Raskar, “Recovering three-dimensional shape around a corner using ultra-fast time-of-flight imaging,” Nat. Commun.3, 745 (2011). [CrossRef]
D. Needell and J. Tropp, “CoSaMP: Iterative signal recovery from incomplete and inaccurate samples,” Appl. Comput. Harmon. Anal.26, 301–321 (2009). [CrossRef]
Hamamatsu, “Hamamatsu streak camera tutorial,” http://learn.hamamatsu.com/tutorials/java/streakcamera/ .
D. Forsyth and J. Ponce, Computer Vision, a Modern Approach (Prentice Hall, 2002).
E. Pettersen, T. Goddard, C. Huang, G. Couch, D. Greenblatt, E. Meng, and T. Ferrin, “UCSF Chimera–a visualization system for exploratory research and analysis,” J. Comput. Chem.25, 1605–1612 (2004). [CrossRef] [PubMed]
B. Atcheson, I. Ihrke, W. Heidrich, A. Tevs, D. Bradley, M. Magnor, and H. Seidel, “Time-resolved 3d capture of non-stationary gas flows,” ACM Trans. Graphics27, 1–9 (2008). [CrossRef]

Atcheson, B.
Bardagjy, A.
Bawendi, M. G.
Bradley, D.
Chen, B.
Couch, G.
Davis, J.
Ferrin, T.
Forsyth, D.
Garg, G.
Goddard, T.
Greenblatt, D.
Grossberg, M. D.
Gupta, O.
Heidrich, W.
Horowitz, M.
Huang, C.
Hutchison, T.
Ihrke, I.
Kirmani, A.
Krishnan, G.
Kutulakos, K. N.
Lensch, H. P. A.
Levoy, M.
Liu, S.
Magnor, M.
Marschner, S. R.
Matsushita, Y.
Meng, E.
Nayar, S. K.
Needell, D.
Ng, T.
Pandharkar, R.
Pettersen, E.
Ponce, J.
Raskar, R.
Seidel, H.
Seitz, S. M.
Sen, P.
Tevs, A.
Tropp, J.
Veeraraghavan, A.
Velten, A.
Willwacher, T.

ACM Trans. Graphics

P. Sen, B. Chen, G. Garg, S. R. Marschner, M. Horowitz, M. Levoy, and H. P. A. Lensch, “Dual photography,” ACM Trans. Graphics24(2), 745–755 (2005). [CrossRef]
S. K. Nayar, G. Krishnan, M. D. Grossberg, and R. Raskar, “Fast separation of direct and global components of a scene using high frequency illumination,” ACM Trans. Graphics25, 935–944 (2006). [CrossRef]
B. Atcheson, I. Ihrke, W. Heidrich, A. Tevs, D. Bradley, M. Magnor, and H. Seidel, “Time-resolved 3d capture of non-stationary gas flows,” ACM Trans. Graphics27, 1–9 (2008). [CrossRef]

Appl. Comput. Harmon. Anal.

D. Needell and J. Tropp, “CoSaMP: Iterative signal recovery from incomplete and inaccurate samples,” Appl. Comput. Harmon. Anal.26, 301–321 (2009). [CrossRef]

J. Comput. Chem.

E. Pettersen, T. Goddard, C. Huang, G. Couch, D. Greenblatt, E. Meng, and T. Ferrin, “UCSF Chimera–a visualization system for exploratory research and analysis,” J. Comput. Chem.25, 1605–1612 (2004). [CrossRef] [PubMed]

Nat. Commun.

A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and R. Raskar, “Recovering three-dimensional shape around a corner using ultra-fast time-of-flight imaging,” Nat. Commun.3, 745 (2011). [CrossRef]

Proc. of CVPR

R. Pandharkar, A. Velten, A. Bardagjy, M. G. Bawendi, and R. Raskar, “Estimating motion and size of moving non-line-of-sight objects in cluttered environments,” in Proc. of CVPR (2011), pp. 265–272. [CrossRef]

Proc. of ECCV

S. Liu, T. Ng, and Y. Matsushita, “Shape from second-bounce of light transport,” in Proc. of ECCV (2010), pp. 280–293.

Other

R. Raskar and J. Davis, “5D time-light transport matrix: What can we reason about scene properties,” MIT Technical Report (2008), http://hdl.handle.net/1721.1/67888 .
Hamamatsu, “Hamamatsu streak camera tutorial,” http://learn.hamamatsu.com/tutorials/java/streakcamera/ .
D. Forsyth and J. Ponce, Computer Vision, a Modern Approach (Prentice Hall, 2002).
A. Kirmani, T. Hutchison, J. Davis, and R. Raskar, “Looking around the corner using transient imaging,” in Proc. of IEEE ICCV (2009), pp. 159–166.
S. M. Seitz, Y. Matsushita, and K. N. Kutulakos, “A theory of inverse light transport,” in Proc. of IEEE ICCV (2005), Vol. 2, pp. 1440–1447.

2011, Pandharkar, Proc. of CVPR
2011, Velten, Nat. Commun.
2010, Liu, Proc. of ECCV
2009, Needell, Appl. Comput. Harmon. Anal.
2008, Atcheson, ACM Trans. Graphics
2006, Nayar, ACM Trans. Graphics
2005, Sen, ACM Trans. Graphics
2004, Pettersen, J. Comput. Chem.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Click here to see a list of articles that cite this paper