Depth maps captured by range scanning devices or by using optical cameras often suffer from missing regions due to occlusions, reflectivity, limited scanning area, sensor imperfections, etc. In this paper, we propose a fast and reliable algorithm for depth map inpainting using the tensor voting (TV) framework. For less complex missing regions, local edge and depth information is utilized for synthesizing missing values. The depth variations are modeled by local planes using 3D TV, and missing values are estimated using plane equations. For large and complex missing regions, we collect and evaluate depth estimates from self-similar (training) datasets. We align the depth maps of the training set with the target (defective) depth map and evaluate the goodness of depth estimates among candidate values using 3D TV. We demonstrate the effectiveness of the proposed approaches on real as well as synthetic data.
© 2013 Optical Society of America
Original Manuscript: October 26, 2012
Revised Manuscript: April 8, 2013
Manuscript Accepted: April 8, 2013
Published: May 15, 2013
Mandar Kulkarni and Ambasamudram N. Rajagopalan, "Depth inpainting by tensor voting," J. Opt. Soc. Am. A 30, 1155-1165 (2013)