OSA's Digital Library

Advances in Optics and Photonics

Advances in Optics and Photonics

| BRINGING REVIEWS AND TUTORIALS TO LIGHT

  • Editor: Bahaa E. A. Saleh
  • Vol. 3, Iss. 2 — Jun. 30, 2011

Structured-light 3D surface imaging: a tutorial

Jason Geng  »View Author Affiliations


Advances in Optics and Photonics, Vol. 3, Issue 2, pp. 128-160 (2011)
http://dx.doi.org/10.1364/AOP.3.000128


View Full Text Article

Acrobat PDF (3156 KB) Open Access





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We provide a review of recent advances in 3D surface imaging technologies. We focus particularly on noncontact 3D surface measurement techniques based on structured illumination. The high-speed and high-resolution pattern projection capability offered by the digital light projection technology, together with the recent advances in imaging sensor technologies, may enable new generation systems for 3D surface measurement applications that will provide much better functionality and performance than existing ones in terms of speed, accuracy, resolution, modularization, and ease of use. Performance indexes of 3D imaging system are discussed, and various 3D surface imaging schemes are categorized, illustrated, and compared. Calibration techniques are also discussed, since they play critical roles in achieving the required precision. Numerous applications of 3D surface imaging technologies are discussed with several examples.

© 2011 OSA

OCIS Codes
(110.6880) Imaging systems : Three-dimensional image acquisition
(150.6910) Machine vision : Three-dimensional sensing

ToC Category:
Imaging Systems

History
Original Manuscript: September 22, 2010
Revised Manuscript: December 10, 2010
Manuscript Accepted: December 20, 2010
Published: March 31, 2011

Virtual Issues
(2011) Advances in Optics and Photonics

Citation
Jason Geng, "Structured-light 3D surface imaging: a tutorial," Adv. Opt. Photon. 3, 128-160 (2011)
http://www.opticsinfobase.org/aop/abstract.cfm?URI=aop-3-2-128


Sort:  Author  |  Year  |  Journal  |  Reset

References

  1. I. Ishii, K. Yamamoto, K. Doi, and T. Tsuji, "High-speed 3D image acquisition using coded structured light projection," IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007. IROS 2007, 2007, IEEE, pp. 925‒930.
  2. K. Sato and S. Inokuchi, "Range-imaging system utilizing nematic liquid crystal mask," Proceedings of International Conference on Computer Vision, 1987, IEEE Computer Society Press, pp. 657‒661.
  3. R. J. Valkenburg and A. M. McIvor, "Accurate 3D measurement using a structured light system," Image Vision Comput. 16, (2), 99‒110 (1998). [CrossRef]
  4. J. L. Posdamer and M. D. Altschuler, "Surface measurement by space-encoded projected beam systems," Comput. Graph. Image Processing 18, (1), 1‒17 (1982). [CrossRef]
  5. S. Inokuchi, K. Sato, and F. Matsuda, "Range-imaging for 3-D object recognition," International Conference on Pattern Recognition, 1984, International Association for Pattern Recognition, pp. 806‒808.
  6. D. Caspi, N. Kiryati, and J. Shamir, "Range imaging with adaptive color structured light," IEEE Trans. Pattern Anal. Mach. Intell. 20, (5), 470‒480 (May 1998). [CrossRef]
  7. W. Krattenthaler, K. J. Mayer, and H. P. Duwe, "3D-surface measurement with coded light approach," Proceedings of the 17th Meeting of the Austrian Association for Pattern Recognition on Image Analysis and Synthesis, Vol. 12, 1993, R. Oldenbourg Verlag, pp. 103‒114.
  8. E. Horn and N. Kiryati, "Toward optimal structured light patterns," Image Vision Comput. 17, (2), 87‒97 (1999). [CrossRef]
  9. H. Sagan, Space Filling Curves, Springer, 1994.
  10. P. S. Huang and S. Zhang, "A fast three-step phase shifting algorithm," Appl. Opt. 45, (21), 5086‒5091 (2006). [CrossRef] [PubMed]
  11. S. Zhang and S. T. Yau, "High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method," Opt. Express 14, 2644‒2649 (2006). [CrossRef] [PubMed]
  12. S. Siva Gorthi and P. Rastogi, "Fringe projection techniques: whither we are?," Opt. Lasers Eng. 48, (2), 133‒140 (2010). [CrossRef]
  13. R. Woodham, "Photometric method for determining surface orientation from multiple images," Opt. Eng. 19, (1), 134‒140 (1980).
  14. R. Basri and D. Jacobs, "Photometric stereo with general, unknown lighting," 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001), 2001, IEEE Computer Society, pp. 374‒381.
  15. A. Treuille, A. Hertzmann, and S. M. Seitz, "Example-based stereo with general BRDFs," Computer Vision—ECCV 2004: 8th European Conference on Computer Vision, Part II, 2004, Springer, pp. 457‒469.
  16. T. Higo, Y. Matsushita, N. Joshi, and K. Ikeuchi, "A hand-held photometric stereo camera for 3-D modeling," 2009 IEEE 12th International Conference on Computer Vision, Sept. 2009, pp. 1234‒1241.
  17. Z. J. Geng, "Rainbow three-dimensional camera: new concept of high-speed three-dimensional vision systems," Opt. Eng. 35, (2), 376‒383 (1996). [CrossRef]
  18. J. Geng, "Color ranging method for high speed low-cost 3D surface profile measurement," U.S. patent 5,675,407; 7 Oct. 1997.
  19. J. Geng, "High speed three dimensional imaging method," U.S. patent 6,028,672; 22 Feb. 2000.
  20. J. Geng, "High speed three dimensional imaging method," U.S. patent 6,147,760; 14 Nov. 2000.
  21. J. Geng, "3D surface profile imaging method and apparatus using single spectral light condition," U.S. patent 6,556,706; 29 Apr. 2003.
  22. J. Geng, "Three-dimensional dental imaging method and apparatus having a reflective member," U.S. patent 6,594,539; 15 July 2003.
  23. J. Geng, "High speed laser three-dimensional imager," U.S. patent 6,660,168; 29 July 2003.
  24. J. Geng, "Method and apparatus for 3D imaging using light pattern having multiple sub-patterns," U.S. patent 6,700,669; 2 March 2004.
  25. C. L. Heike, K. Upson, E. Stuhaug, and S. M. Weinberg, "3D digital stereophotogrammetry: a practical guide to facial image acquisition," Head Face Med. 6, (1), 18 (2010). [CrossRef] [PubMed]
  26. K. L. Boyer and A. C. Kak, "Color-encoded structured light for rapid active ranging," IEEE Trans. Pattern Anal. Mach. Intell. 9, (1), 14‒28 (1987). [CrossRef]
  27. S. Fernandez, J. Salvi, and T. Pribanic, "Absolute phase mapping for one-shot dense pattern projection," 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), June 3–18, 2010, San Francisco, Calif..
  28. M. Maruyama and S. Abe, "Range sensing by projecting multiple slits with random cuts," IEEE Trans. Pattern Anal. Mach. Intell. 15, (6), 647‒651 (1993). [CrossRef]
  29. N. G. Durdle, J. Thayyoor, and V. J. Raso, "An improved structured light technique for surface reconstruction of the human trunk," IEEE Canadian Conference on Electrical and Computer Engineering, 1998, Vol. 2, 1998, IEEE, pp. 874‒877.
  30. F. J. MacWilliams and N. J. A. Sloane, "Pseudorandom sequences and arrays," Proc. IEEE 64, (12), 1715‒1729 (1976). [CrossRef]
  31. H. Fredricksen, "A survey of full length nonlinear shift register cycle algorithms," Soc. Industr. Appl. Math. Rev. 24, (2), 195‒221 (1982).
  32. H. Hügli and G. Maïtre, "Generation and use of color pseudo-random sequences for coding structured light in active ranging," Proc. SPIE 1010, 75‒82 (1989).
  33. T. Monks and J. Carter, "Improved stripe matching for colour encoded structured light," Computer Analysis of Images and Patterns, 1993, Springer, pp. 476‒485.
  34. T. Pajdla, "Bcrf—binary-coded illumination range finder reimplementation," Technical Report KUL/ESAT/MI2/9502, Katholieke Universiteit Leuven, 1995.
  35. L. Zhang, B. Curless, and S. M. Seitz, "Rapid shape acquisition using color structured light and multi-pass dynamic programming," First International Symposium on 3D Data Processing Visualization and Transmission, 2002. Proceedings, 2002, IEEE, pp. 24‒36.
  36. J. Le Moigne and A. M. Waxman, "Multi-resolution grid patterns for building range maps," Vision ’85, Applied Machine Vision Conference (ASME), 1985, Society of Manufacturing Engineers, pp. 22‒39.
  37. H. Morita, K. Yajima, and S. Sakata, "Reconstruction of surfaces of 3-D objects by M-array pattern projection method," Second International Conference on Computer Vision, 1988, IEEE Computer Society, pp. 468‒473.
  38. J. Le Moigne and A. M. Waxman, "Structured light patterns for robot mobility," IEEE J. Robot. Automat. 4, (5), 541‒548 (1988). [CrossRef]
  39. P. Payeur and D. Desjardins, "Structured light stereoscopic imaging with dynamic pseudo-random patterns," Image Analysis and Recognition, Lecture Notes in Computer Science, Vol. 5627/2009, Springer, 2009, pp. 687‒696.
  40. A. Osman Ulusoy, F. Calakli, and G. Taubin, "One-shot scanning using De Bruijn spaced grids," 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), 2009, IEEE, pp. 1786‒1792.
  41. P. M. Grin, L. S. Narasimhan, and S. R. Yee, "Generation of uniquely encoded light patterns for range data acquisition," Pattern Recog. 25, (6), 609‒616 (1992). [CrossRef]
  42. E. M. Petriu, Z. Sakr, H. J. W. Spoelder, and A. Moica, "Object recognition using pseudo-random color encoded structured light," Proceedings of the 17th IEEE Instrumentation and Measurement Technology Conference, 2000. IMTC 2000, Vol. 3, 2000, IEEE, pp. 1237‒1241.
  43. J. Pagès, J. Salvi, and C. Matabosch, "Robust segmentation and decoding of a grid pattern for structured light," Pattern Recognition and Image Analysis, Lecture Notes in Computer Science, Vol. 2652/2003, Springer, 2003, pp. 689‒696.
  44. A. Osman Ulusoy, F. Calakli, and G. Taubin, "Robust one-shot 3D scanning using loopy belief propagation," 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2010, IEEE Computer Society, pp. 15‒22.
  45. P. Payeur and D. Desjardins, "Structured light stereoscopic imaging with dynamic pseudo-random patterns," Image Analysis and Recognition, Lecture Notes in Computer Science, Vol. 5627/2009, Springer, 2009, pp. 687‒696.
  46. D. Desjardins and P. Payeur, "Dense stereo range sensing with marching pseudo-random patterns," Fourth Canadian Conference on Computer and Robot Vision (CRV ’07), 2007, IEEE Computer Society, pp. 216‒226.
  47. R. Y. Tsai, "A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE J. Robotics Automat. 3, (4), 323‒344 (1987). [CrossRef]
  48. Z. Zhang, "Flexible camera calibration by viewing a plane from unknown orientations," Seventh International Conference on Computer Vision (ICCV’99), Vol. 1, 1999, IEEE Computer Society, p. 666.
  49. J. Heikkil and O. Silven, "A four-step camera calibration procedure with implicit image correction," 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997. Proceedings, 1997, IEEE Computer Society, pp. 1106‒1112.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Supplementary Material


» Media 1: MOV (5934 KB)     

Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited