OSA's Digital Library

Journal of the Optical Society of America A

Journal of the Optical Society of America A

| OPTICS, IMAGE SCIENCE, AND VISION

  • Vol. 17, Iss. 8 — Aug. 1, 2000
  • pp: 1371–1381

Color from shape from color: a simple formalism with known light sources

Mark S. Drew and Michael H. Brill  »View Author Affiliations


JOSA A, Vol. 17, Issue 8, pp. 1371-1381 (2000)
http://dx.doi.org/10.1364/JOSAA.17.001371


View Full Text Article

Enhanced HTML    Acrobat PDF (588 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Photometric stereo is a well-known technique for recovering surface normals of a surface but requires three or more images of a surface taken under illumination from different directions. At best, one may dispense with the need for multiple images by using colored lights tuned to camera filters. But a less restrictive paradigm is available that uses the orientation-from-color approach, wherein multiple broadband illuminants impinge on a surface simultaneously. In that method, colors for a Lambertian surface lie on an ellipsoid in color space. The method has been applied mainly to single-color objects, with ellipsoid quadratic-form parameters determined from a large number of pixels. However, recently Petrov and Antonova [Color Res.Appl. 21, 97 (1996)] developed an entirely local approach, useful also for multicolored objects with color uniform in each patch. We investigate to what extent a method such as that of Petrov and Antonova can be applied in the ostensibly simpler situation in which the complex lighting environment is known, i.e., a color photometric stereo situation, with all lights in play at once with only a single image to analyze. We find that, assuming a simple model of color formation, we are able to recover the object colors along with surface normals, using only a single image. Because we immerse the object in a known lighting environment, we show that only half of the equations utilized by Petrov and Antonova are actually needed, making the method more stable. Nevertheless, solutions do not exist at every pixel; instead we may determine a best estimate of patch color, using a robust estimator, and then apply that estimate throughout a patch. Results are shown to be quite good compared with ground truth. The simple color model can often be made to hold more exactly by transforming the color space into one corresponding to spectrally sharpened sensors, which are a matrix transform away from the actual camera sensors. In our study the reliability and accuracy of the normal vector and of the surface color recovery algorithm are improved by this straightforward transformation.

© 2000 Optical Society of America

OCIS Codes
(100.2960) Image processing : Image analysis
(100.3190) Image processing : Inverse problems
(150.0150) Machine vision : Machine vision
(330.1720) Vision, color, and visual optics : Color vision

History
Original Manuscript: May 21, 1999
Revised Manuscript: December 22, 1999
Manuscript Accepted: December 22, 1999
Published: August 1, 2000

Citation
Mark S. Drew and Michael H. Brill, "Color from shape from color: a simple formalism with known light sources," J. Opt. Soc. Am. A 17, 1371-1381 (2000)
http://www.opticsinfobase.org/josaa/abstract.cfm?URI=josaa-17-8-1371

You do not have subscription access to this journal. Citation lists with outbound citation links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

You do not have subscription access to this journal. Article level metrics are available to subscribers only. You may subscribe either as an OSA member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Log in to access OSA Member Subscription

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited