Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Color from shape from color: a simple formalism with known light sources

Not Accessible

Your library or personal account may give you access

Abstract

Photometric stereo is a well-known technique for recovering surface normals of a surface but requires three or more images of a surface taken under illumination from different directions. At best, one may dispense with the need for multiple images by using colored lights tuned to camera filters. But a less restrictive paradigm is available that uses the orientation-from-color approach, wherein multiple broadband illuminants impinge on a surface simultaneously. In that method, colors for a Lambertian surface lie on an ellipsoid in color space. The method has been applied mainly to single-color objects, with ellipsoid quadratic-form parameters determined from a large number of pixels. However, recently Petrov and Antonova [Color Res.Appl. 21, 97 (1996)] developed an entirely local approach, useful also for multicolored objects with color uniform in each patch. We investigate to what extent a method such as that of Petrov and Antonova can be applied in the ostensibly simpler situation in which the complex lighting environment is known, i.e., a color photometric stereo situation, with all lights in play at once with only a single image to analyze. We find that, assuming a simple model of color formation, we are able to recover the object colors along with surface normals, using only a single image. Because we immerse the object in a known lighting environment, we show that only half of the equations utilized by Petrov and Antonova are actually needed, making the method more stable. Nevertheless, solutions do not exist at every pixel; instead we may determine a best estimate of patch color, using a robust estimator, and then apply that estimate throughout a patch. Results are shown to be quite good compared with ground truth. The simple color model can often be made to hold more exactly by transforming the color space into one corresponding to spectrally sharpened sensors, which are a matrix transform away from the actual camera sensors. In our study the reliability and accuracy of the normal vector and of the surface color recovery algorithm are improved by this straightforward transformation.

© 2000 Optical Society of America

Full Article  |  PDF Article
More Like This
Classifying the illumination condition from two light sources by color histogram assessment

Hans Jørgen Andersen and Erik Granum
J. Opt. Soc. Am. A 17(4) 667-676 (2000)

Spectral sharpening with positivity

Mark S. Drew and Graham D. Finlayson
J. Opt. Soc. Am. A 17(8) 1361-1370 (2000)

Multispectral processing without spectra

Mark S. Drew and Graham D. Finlayson
J. Opt. Soc. Am. A 20(7) 1181-1193 (2003)

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (6)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Tables (1)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (64)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All Rights Reserved