OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 22, Iss. 6 — Jun. 1, 2005
  • pp: 1066–1076

Joint blind restoration and surface recovery in photometric stereo

Manjunath V. Joshi and Subhasis Chaudhuri  »View Author Affiliations


JOSA A, Vol. 22, Issue 6, pp. 1066-1076 (2005)
http://dx.doi.org/10.1364/JOSAA.22.001066


View Full Text Article

Enhanced HTML    Acrobat PDF (938 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We address the problem of simultaneous estimation of scene structure and restoration of images from blurred photometric measurements. In photometric stereo, the structure of an object is determined by using a particular reflectance model (the image irradiance equation) without considering the blurring effect. What we show is that, given arbitrarily blurred observations of a static scene captured with a stationary camera under different illuminant directions, we still can obtain the structure represented by the surface gradients and the albedo and also perform a blind image restoration. The surface gradients and the albedo are modeled as separate Markov random fields, and a suitable regularization scheme is used to estimate the different fields as well as the blur parameter. The results of the experimentations are illustrated with real as well as synthetic images.

© 2005 Optical Society of America

OCIS Codes
(100.0100) Image processing : Image processing
(100.3020) Image processing : Image reconstruction-restoration
(120.0120) Instrumentation, measurement, and metrology : Instrumentation, measurement, and metrology
(120.5240) Instrumentation, measurement, and metrology : Photometry
(150.0150) Machine vision : Machine vision
(150.6910) Machine vision : Three-dimensional sensing

History
Original Manuscript: August 20, 2004
Manuscript Accepted: October 18, 2004
Published: June 1, 2005

Citation
Manjunath V. Joshi and Subhasis Chaudhuri, "Joint blind restoration and surface recovery in photometric stereo," J. Opt. Soc. Am. A 22, 1066-1076 (2005)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-22-6-1066


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. B. K. P. Horn, “Shape from shading: a method for obtaining the shape of a smooth opaque object from one view,” Ph.D. thesis (Massachussetts Institute of Technology, Cambridge, Mass., 1970).
  2. K. Ikeuchi, B. K. P. Horn, “Numerical shape from shading and occluding boundaries,” Artif. Intell. 17, 141–184 (1981). [CrossRef]
  3. A. P. Pentland, “Local shading analysis,” IEEE Trans. Pattern Anal. Mach. Intell. 6, 170–187 (1984). [CrossRef] [PubMed]
  4. A. P. Pentland, “Shape information from shading: a theory about human perception,” in Proceedings of the International Conference on Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 1988), pp. 404–413.
  5. P. S. Tsai, M. Shah, “Shape from shading using linear approximation,” Image Vis. Comput. 12, 487–498 (1994). [CrossRef]
  6. R. J. Woodham, “Reflectance map techniques for analyzing surface defects in metal castings,” Tech. Rep. 457 (MIT Artificial Intelligence Laboratory, Cambridge, Mass., 1978).
  7. R. J. Woodham, “Photometric method for determining surface orientation from multiple images,” Opt. Eng. (Bellingham) 19, 139–144 (1980). [CrossRef]
  8. K. Ikeuchi, “Determining surface orientations of specular surfaces by using the photometric stereo method,” IEEE Trans. Pattern Anal. Mach. Intell. 3, 661–669 (1981). [CrossRef] [PubMed]
  9. W. M. Silver, “Determining shape and reflectance using multiple images,” M.S. thesis (Massachusetts Institute of Technology, Cambridge, Mass., 1980).
  10. K. M. Lee, C. C. Jay Kuo, “Shape reconstruction from photometric stereo,” in Proceedings of the International Conference on Computer Vision and Pattern Recognition (IEEE Computer Society Press, Los Alamitos, Calif., 1992), pp. 479–484.
  11. C. Y. Chen, R. Klette, R. Kakarala, “Albedo recovery using a photometric stereo approach,” in Proceedings of the International Conference on Pattern Recognition (IEEE Computer Society Press, Los Alamitos, Calif., 2002), pp. 700–703.
  12. Y. Iwahori, R. J. Woodham, M. Ozaki, H. Tanaka, N. Ishi, “Neural network based photometric stereo with a nearby rotational moving light source,” IEICE Trans. Inf. Syst. E-80-D, 948–957 (1997).
  13. Y. Iwahori, R. J. Woodhan, A. Bagheri, “Principal component analysis and neural network implementation of Photometric Stereo,” in Proceedings of the Workshop on Physics based Modeling in Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 1995), pp. 117–125.
  14. R. J. Woodham, “Gradient and curvature from the photometric stereo method including local confidence estimation,” J. Opt. Soc. Am. A 11, 3050–3068 (1994). [CrossRef]
  15. Y. Iwahori, R. J. Woodham, Y. Watanabe, A. Iwata, “Self calibration and neural network implementation of photometric stereo,” in Proceedings of the International Conference on Pattern Recognition (IEEE Computer Society Press, Los Alamitos, Calif., 2002), pp. 359–362.
  16. O. Drbohlav, R. Sara, “Unambiguous determination of shape from photometric stereo with unknown light sources,” in Proceedings of the International Conference on Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 2001), pp. 581–586.
  17. R. Basri, D. Jacobs, “Photometric stereo with general unknown lighting,” in Proceedings of the International Conference on Computer Vision and Pattern Recognition (IEEE Computer Society Press, Los Alamitos, Calif., 2001), pp. 374–381.
  18. U. Sakarya, I. Erkmen, “An improved method of photometric stereo using local shape from shading,” Image Vis. Comput. 21, 941–954 (2003). [CrossRef]
  19. J. J. Clark, “Active photometric stereo,” in Proceedings of the International Conference on Computer Vision and Pattern Recognition (IEEE Computer Society Press, Los Alamitos, Calif., 1992), pp. 29–34.
  20. J. R. A. Torreao, “A new approach to photometric stereo,” Pattern Recogn. Lett. 20, 535–540 (1999). [CrossRef]
  21. G. McGunnigle, M. J. Chantler, “Rotation invariant classification of rough surfaces,” IEE Proc. Vision Image Signal Process. 146, 345–352 (1999). [CrossRef]
  22. G. McGunnigle, M. J. Chantler, “Rough surface classification using point statistics from photometric stereo,” Protein Eng. 21, 593–604 (2000).
  23. G. McGunnigle, M. J. Chantler, “Modelling deposition of surface texture,” Electron. Lett. 37, 749–750 (2001). [CrossRef]
  24. M. L. Smith, T. Hill, G. Smith, “Gradient space analysis of surface defects using a photometric stereo derived bump map,” Image Vis. Comput. 17, 321–332 (1999). [CrossRef]
  25. P. Hansson, P. Johansson, “Topography and reflectance analysis of paper surfaces using photometric stereo method,” Opt. Eng. (Bellingham) 39, 2555–2561 (2000). [CrossRef]
  26. G. McGunnigle, M. J. Chantler, “Segmentation of machined surfaces,” presented at the Irish Machine Vision and Image Processing Conference, Maynooth, Ireland, September, 2001.
  27. M. R. Banham, A. K. Katsaggelos, “Digital image restoration,” IEEE Signal Process. Mag. Vol. 14 (2) 1997, pp. 24–41. [CrossRef]
  28. D. Rajan, S. Chaudhuri, “Simultaneous estimation of super-resolved scene and depth map from low resolution defocused observations,” IEEE Trans. Pattern Anal. Mach. Intell. 25, 1102–1117 (2003). [CrossRef]
  29. A. N. Rajagopalan, S. Chaudhuri, “An MRF model based approach to simultaneous recovery of depth and restoration from defocused images,” IEEE Trans. Pattern Anal. Mach. Intell. 21, 577–589 (1999). [CrossRef]
  30. D. Kundur, D. Hatzinakos, “Blind image deconvolution,” IEEE Signal Process. Mag. March 1996, pp. 43–64.
  31. Y. You, M. Kaveh, “A regularization approach to joint blind identification and image restoration,” IEEE Trans. Image Process. 5, 416–428 (1996). [CrossRef]
  32. R. L. Lagendijk, J. Biemond, Iterative Identification and Restoration of Images, (Kluwer Academic, Boston, Mass., 2001).
  33. R. L. Lagendijk, J. Biemond, D. E. Boekee, “Identification and restoration of noisy blurred images using the expectation maximization algorithm,” IEEE Trans. Acoust., Speech, Signal Process. 38, 1180–1191 (1990). [CrossRef]
  34. K. T. Lay, A. K. Katsaggelos, “Image identification and restoration based on the expectation maximization algorithm,” Opt. Eng. (Bellingham) 29, 436–445 (1990). [CrossRef]
  35. M. K. Ozkan, A. M. Tekalp, M. I. Sezan, “POCS based restoration of space varying blurred images,” IEEE Trans. Image Process. 3, 450–454 (1995). [CrossRef]
  36. M. I. Sezan, A. M. Tekalp, “Iterative image restoration with ringing suppression using POCS,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (IEEE Press, Piscataway, N.J., 1988), pp. 1300–1303.
  37. M. I. Sezan, H. J. Trussell, “Prototype image constraints for set theoretic image restoration,” IEEE Trans. Signal Process. 39, 2275–2285 (1991). [CrossRef]
  38. H. J. Trussell, M. R. Civanlar, “The feasible solution in signal restoration,” IEEE Trans. Acoust., Speech, Signal Process. 32, 201–212 (1984). [CrossRef]
  39. Y. Yang, N. P. Galatsanos, A. K. Katsaggelos, “Projection-based spatially adaptive reconstruction of block-transform compressed images,” IEEE Trans. Image Process. 4, 896–908 (1995). [CrossRef] [PubMed]
  40. V. F. Candela, A. Marquina, S. Serna, “A local spectral inversion of a linearized TV model for denoising and deblurring,” IEEE Trans. Image Process. 12, 808–816 (2003). [CrossRef]
  41. B. Besserer, L. Joyeux, S. Boukir, O. Buisson, “Reconstruction of degraded image sequences. Application to film restoration,” Image Vis. Comput. 19, 503–516 (2001). [CrossRef]
  42. L. Bedini, A. Tonazzini, S. Minutoli, “Unsupervised edge-preserving image restoration via a saddle point approximation,” Image Vis. Comput. 17, 779–793 (1999). [CrossRef]
  43. B. K. P. Horn, Robot Vision (MIT Press, Cambridge, Mass., 1986).
  44. S. Chaudhuri, A. N. Rajagopalan, Depth From Defocus: A Real Aperture Imaging Approach (Springer-Verlag, New York, 1999).
  45. R. C. Dubes, A. K. Jain, “Random field models in image analysis,” J. Appl. Statistics 16, 131–164 (1989). [CrossRef]
  46. J. Besag, “Spatial interaction and the statistical analysis of lattice systems,” J. R. Stat. Soc. Ser. B. Methodol. 36, 192–236 (1974).
  47. M. Subbarao, “Parallel depth recovery by changing camera parameters,” in Proceedings of the International Conference on Computer Vision (IEEE Computer Society Press, Los Alamitos, Calif., 1998), pp. 149–155.
  48. T. F. Chan, C. K. Wong, “Convergence of the alternating minimization algorithm for blind deconvolution,” Tech. Rep. 19, UCLA Computational and Applied Mathematics Series (University of California, Los Angeles, Calif., 1999).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited