OSA's Digital Library

Virtual Journal for Biomedical Optics

Virtual Journal for Biomedical Optics

| EXPLORING THE INTERFACE OF LIGHT AND BIOMEDICINE

  • Editor: Gregory W. Faris
  • Vol. 4, Iss. 2 — Feb. 10, 2009
« Show journal navigation

Remote plethysmographic imaging using ambient light.

Wim Verkruysse, Lars O Svaasand, and J Stuart Nelson  »View Author Affiliations


Optics Express, Vol. 16, Issue 26, pp. 21434-21445 (2008)
http://dx.doi.org/10.1364/OE.16.021434


View Full Text Article

Acrobat PDF (1265 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Plethysmographic signals were measured remotely (>1m) using ambient light and a simple consumer level digital camera in movie mode. Heart and respiration rates could be quantified up to several harmonics. Although the green channel featuring the strongest plethysmographic signal, corresponding to an absorption peak by (oxy-) hemoglobin, the red and blue channels also contained plethysmographic information. The results show that ambient light photo-plethysmography may be useful for medical purposes such as characterization of vascular skin lesions (e.g., port wine stains) and remote sensing of vital signs (e.g., heart and respiration rates) for triage or sports purposes.

© 2008 Optical Society of America

1. Introduction

Detection of the cardio-vascular pulse wave traveling through the body is referred to as Plethysmography (‘Plethysmos’ = increase in Greek) and can be done by means such as variations in air pressure, impedance, or strain. Photo-plethysmography (PPG), introduced in the 1930’s [1

1. A. B. Hertzman and C. R. Spealman, “Observations on the finger volume pulse recorded photo-electrically,” Am. J. Physiol. 119, 334–335 (1937).

] uses light reflectance or transmission and is the least expensive method and simple to use. PPG is based on the principle that blood absorbs light more than surrounding tissue so variations in blood volume affect transmission or reflectance correspondingly. Applications of PPG include monitoring of oxygen saturation (pulse oxymetry), heart (HR) and respiration (RR) rates, blood pressure, cardiac output, assessment of autonomic functions and detection of peripheral vascular diseases. Remote, non-contact pulse oxymetry and PPG imaging have been explored only relatively recently [2

2. F. P. Wieringa, F. Mastik, and A. F. W. van der Steen, “Contactless multiple wavelength photoplethysmographic imaging: A first step toward “SpO(2) camera” technology,” Ann. Biomed. Eng. 33, 1034–1041 (2005). [CrossRef] [PubMed]

, 3

3. S. Hu, J. Zheng, V. Chouliaras, and R. Summers, “Feasibility of imaging photoplethysmography,” in Proceedings of the International Conference on BioMedical Engineering and Informatics, (Institute of Electrical and Electronics Engineers, NewYork, 2008), pp. 72–75.

].

To our knowledge, PPG has always been performed with dedicated light sources and typically red and/or infra-red (IR) wavelengths. Due to the historical emphasis of PPG on pulse oxymetry and the associated need to sample relatively deep (e.g., 1 mm) veins and arteries, the visible spectrum (with a shallower penetration depth in skin) has often been ignored as a light source for PPG. Publications describing non-red visible light sources for PPG (e.g. green) are either recent [4

4. L. Gailite, J. Spigulis, and A. Lihachev, “Multilaser photoplethysmography technique,” Lasers Med. Sci. 23, 189–193 (2008). [CrossRef]

, 5

5. A. Jonsson, “Pressure Sore Etiology - Highlighted with Optical Measurements of the Blood Flow,Chapter 3, New sensor design made to discriminate between tissue blood flow at different tissue depths at the sacral area,” PhD thesis (Mälardalen University Press, 2006).

] or relatively old [6

6. L. G. Lindberg and P. A. Oberg, “Photoplethysmography II. Influence of light-source wavelength,” Med. Biol. Eng. Comput. 29, 48–54 (1991). [CrossRef] [PubMed]

, 7

7. J. A. Crowe and D. Damianou, “The Wavelength Dependence of the Photoplethysmogram and its implication to Pulse Oximetry,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (Institute of Electrical and Electronics Engineers, NewYork, 1992), pp. 2423–2424.

], and, in all cases, contact probes were used. Ambient visible light is often considered a source of noise [8

8. P. Y. Cheang and P. R. Smith, “An Overview of Non-contact Photoplethysmography” (Department of Electronic and Electrical Engineering, Loughborough University, LE11 3TU, UK, 2003), retrieved August 27, 2008, http://www.lboro.ac.uk/departments/el/research/esc-miniconference/papers/cheang.pdf.

11

11. N. S. Trivedi, A. F. Ghouri, N. K. Shah, E. Lai, and S. J. Barker, “Effects of motion, ambient light, and hypoperfusion on pulse oximeter function,” J. Clin. Anesth. 9, 179–183 (1997). [CrossRef] [PubMed]

] when using IR light sources and detectors sensitive for IR and visible light.

In this communication, we show that PPG signals can be remotely (several m) measured on the human face with normal ambient light as the source and a simple digital, consumer level photo camera in movie mode. At distances of 1.5 m, signal to noise ratio (SNR) was such that up to four harmonics of the fundamental HR frequency can be measured, thus rendering not only the HR but also the shape of the waveform. In addition to HR and RR monitoring, we show that PPG imaging can be used to characterize regions of high and low pulsatility on facial port wine stains (PWS). PWS are cutaneous capillary malformations characterized by a higher number and/or a larger size of the pathologic capillaries [12

12. S. H. Barsky, S. Rosen, D. E. Geer, and J. M. Noe, “The nature and evolution of port wine stains: A computer-assisted study,” J. Invest. Dermatol. 74, 154–157 (1980). [CrossRef] [PubMed]

]. A better understanding of the hemodynamics involved in PWS is of great interest to improve laser therapeutic outcome.

Our PPG results suggest that not only pulsatility but also phase information regarding the cardio-vascular waveform may be deduced. Although we will attempt to interpret clinical results and discuss their relevance, the main purpose of this paper is to demonstrate remote PPG (imaging) with ambient light. To the best of our knowledge, remote PPG (imaging) with ambient light has never been demonstrated.

2. Methods

2.1 Materials and set-up

Simple, inexpensive (<$200) digital cameras were used (Canon Powershot models A560, A570 and A640). Early measurements were taken with the A640 and A670 but later we preferred to use the A560 because the auto brightness function can be disabled (see discussion). After setting the camera in movie mode volunteers were asked to sit, stand or lie down to minimize any movements. With the camera on a tri-pod, movies were recorded of the facial area. Duration varied from 30 s to several minutes. Typically, daylight was used as the illumination source in combination with normal artificial fluorescent light. In a few cases, movies were taken of a port wine stain (PWS) patient, immediately before or after laser therapy in the operating room (OR) at the Beckman Laser Institute and Medical Clinic, (BLIMC, UC Irvine, CA). Here, the illumination was provided by a surgical lamp at the same light intensity used for surgery. No additional illumination was used in any of the data presented herein. Typically, the distance between camera and object was 1–2 m and no lens, other than the built-in 3x zoom, was used.

2.2 Spatial averaging to improve SNR

Color movies, recorded at either 15 or 30 frames per second (fps) and pixel resolution of 640x480 or 320×240, were saved in AVI format by the camera and transferred to a PC. Using Matlab®, (Mathworks) software, pixel values (PV, 8bit, 0–255) for the red (R), green (G) and blue (B) channels were read for each movie frame providing a set of PV(x,y,t) where x and y are horizontal and vertical positions, respectively, and t is time corresponding to the frame rate. Using a graphic user interface, regions of interest (ROI) were selected in a still (selected from the movie) and the raw signal (PVraw(t)) was calculated as the average of all pixel values in the ROI.

2.3 Digital filtering and spectral analysis (time domain)

Each of the PV(t) signals, from a ROI or a pixel in the coarse grid, is presented in one of the following ways in this paper:

PVraw(t) no processing other than spatial averaging over ROI or coarse grid cell;

PVAC(t) the mean over time of PVraw(t) is subtracted (=PVraw(t) minus DC); or

PVBP(t) band-pass filtered PVraw(t) signal.

For the band-pass (BP) filter Butterworth coefficients (4th order) were used in a phase neutral (forward and reverse) digital filter (“filtfilt” in Matlab®). Cut-off frequencies for the BP filter will be listed in the results section.

Fast Fourier transforms (“FFT” in Matlab®) on PV(t) signals were performed to determine the power and phase spectra for PV(t). Zero padding of PV(t) prior to the Fourier transform was used to allow for a finer discretization of the frequency. We will refer to an nth order zero padding if the original signal was expanded on both sides with a 0 signal of length n times the original time span.

Plethysmographic signals are sometimes presented inverted to render the intensity proportional to blood pressure or volume. In this communication, all signals will be presented directly: a higher signal corresponds to a higher reflectance and smaller blood volume. Although we will indicate how pixel values (the basic measurement unit) relate to reflectance, all signals will be presented in pixel values.

3 Results

3.1 HR and RR detection

Figure 1 shows PVraw(t) signals for the G and B channels (R not shown), extracted from a 290 s movie of a volunteer who was asked to perform 50 knee bends. Five seconds after the exercise ended, the volunteer sat on a chair and was asked to hold his/her unsupported head still. The ROI for which signals are shown is a rectangular area on the forehead (ROI I in Fig. 2(a)). Dips in PVraw(t) (e.g., around t = 35 s and t = 90 s) are likely due to involuntary movements, changing the angle of the forehead slightly, resulting in a lower signal. DC levels or low frequencies (<0.1 Hz) are typically not considered in PPG due to the fact that calibration of such signals is difficult [13

13. J. Allen, “Photoplethysmography and its application in clinical physiological measurement,” Physiol. Meas. 28, R1–R39 (2007). [CrossRef] [PubMed]

]. In our approach, using ambient light and a camera which applies several automatic brightness and color functions on each channel, calibration is an even more difficult task. Herein, we will not address the DC and low frequency variations and instead focus on the AC signals.

The plethysmographic information is visible in the Fig. 1(a) inserts. Oscillations for HR and RR are indicated in the G and B channels, respectively (left insert). The HR is better visible in Figs. 1(b) and (c), displaying the joint time-frequency diagrams of the signals (G and B, respectively) in Fig. 1(a) for a time window of 10 s (300 frames). The HR gradually decreases from t = 0 to 100 s, as the volunteer recuperates from the physical exercise. The HR and RR signals are most pronounced in the G and B channels, respectively, and both decrease gradually during recuperation. The fundamental HR frequency and, even the 2nd through 4th harmonics, can be identified in Fig. 1(b). Detection of the harmonics indicates that both the HR but and the shape of the plethysmogram were determined.

At t = 180 s the volunteer appeared to be fully recuperated and was asked to in- and exhale deeply and, at a more rapid pace, until t = 230 s whereupon the volunteer was asked to breath normally. During this voluntary hyperventilation RR increases in frequency and amplitude (Fig. 1(c)). Simultaneously, HR gradually increases from 1.1 to 1.5 Hz at t = 215 s after which it gradually decreases. HR peaks before hyperventilation stopped, indicating that HR is autonomically controlled and measured independent of RR. The observed RR and HR evolutions are consistent with the literature [14

14. M. J. Ford, M. J. Camilleri, R. B. Hanson, J. A. Wiste, and M. J. Joyner, “Hyperventilation, central autonomic control, and colonic tone in humans,” Gut 37, 499–504 (1995). [CrossRef] [PubMed]

].

Fig. 1. (a): PVraw(t) signals for G and B channels as indicated and a ROI on the forehead (ROI I in Fig. 2(b)). Movie recording started 5 s after the subject finished physical exercise. Boxed areas in (a) are shown as insert graphs. In the left insert (t = 30-50s), HR can be observed to decrease. Impact of voluntary hyperventilation on RR and HR is best seen in the right (t = 185 - 205 s). (b) and (c) Joint time-frequency diagrams (10 s time window) for G and B channels, respectively. HR decreases from 1.7 to 1.1 Hz during recuperation from t = 0 - 120 s. In (c), the band associated with RR initially decreases gradually during recuperation and abruptly increases to 0.3 Hz during hyperventilation.

Fig. 2. (a) PVAC(t) signals (G channel) for four ROI (I–IV) indicated in (b). (c) Corresponding power spectra. Signals for ROI’s II and III are reduced (x 0.1) for clarity. The bar in (a) represents 10 pixel values for II and III and 1 for I and IV. The power spectrum for ROI IV is displayed x5.

ROI IV, encompassing the entire face, illustrates that selection of the ROI is not critical for the HR determination. The amplitude of the HR signal is reduced (due to the inclusion of many background pixels) but the noise is also reduced, leaving the SNR intact: even the 3rd harmonic is well above camera noise level (Fig. 2(c)). Movement artifacts combined with stark contrasts such as the eyes, nose, mouth or face compared to image background PV’s cancel out in the signal for ROI IV. The RR can be clearly identified at 0.27 Hz. The noise level as a function of frequency in Fig. 2(c) (IV) is consistent with 1/frequency noise (not shown), which is characteristic for CCD detectors.

3.2 Modulation of RR and HR

Whereas Figs. 12 show the RR and HR as baseline modulated signals (DC modulation), an example of pulse amplitude modulation (AC modulation) is shown in Fig. 3. Data was extracted from a movie (shown in the left panel in media 1) recorded at 30 fps and 320x240 pixel resolution. Figs. 3(b) and (c) are PVAC(t) and PVBP(t) maps, respectively, for t = 6 s. The display (false color) amplitude for Fig. 3(c) is 5x that of Fig. 3(b) to compensate for the much lower HR amplitude. The full PVAC(t) and PVBP(t) signals (30 s) are shown in Figs. 3(d) and (f) where dashed vertical lines indicate the time for Figs. 3(a–c). The power spectrum for the G channel is shown in Fig. 3(e). The strongest signal at 0.12 Hz represents RR (harmonics are indicated) while 3 peaks in the HR frequency range (1, 1.12 and 1.24 Hz) are consistent with an amplitude modulation of HR at 1.12 Hz with RR at 0.12 Hz. Fig. 3(f) shows PVBP(t) (0.8–6 Hz) also illustrating the ampltidue modulation of RR and HR.

Fig. 3. (a–c) A movie excerpt (frame 179, t = 6 s, (Media1)), selected to demonstrate a low signal for PVAC(t), (b) and high signal for PVBP(t) (c). (d) PVAC (t) for the ROI indicated in (a), for the R, G and B channels, displayed up to t = 30 s (media 1 shows up to t = 15 s). (e) Power spectrum for the G channel indicating amplitude modulation of RR (≈0.12 Hz) and HR (≈1.12 Hz). (f) PVBP (t) signals, displaying an amplitude modulated HR signal for the G channel. Vertical dashed lines in (d) and (f) indicate the time of the movie excerpt.

The amplitude relationship between R, G and B channels shown in Fig. 3(f) is typical for most data we have obtained so far: the strongest plethysmographic signal is for the G channel, although the RR signal is sometimes more pronounced in the R or B channel (as in Fig. 1(c)). Note that the RR signals in Fig. 3d for the three channels are different in shape as well as amplitude, suggesting that they may contain complementary information regarding oxygenation or depth origin of the pulsation (red light penetrates deeper in human skin as compared to blue). The RR induced R and B channel signals are well above the noise level and are lower than the G channel signal possibly due to a low absorption coefficient by blood for the R channel [15

15. E. van Kampen and W. Zijlstra, “Determination of hemoglobin and its derivatives,” in Advances in Clinical Chemistry, H. Sobotka and C. Stewart, eds. (Academic Press, New York, 1965), p. 158.

] and a small probing volume for the B channel. The HR signals for the R and B channels in Fig 3(f) are close to the noise level.

3.3 Pulse amplitude mapping

As discussed in section 3.1 and illustrated by the signal for ROI III in Fig. 2, movement artifacts are likely not HR related, however, they are still important when generating pulsatility (power) maps. Areas with high contrast moving in and out of the ROI will feature strong fluctuations and, thus, correspond to increased powers for a large range of frequencies, including the HR (e.g., see the power spectrum for ROI III in Fig. 2(c),).

A simple method to reduce such artifacts in power maps is illustrated in Fig. 4. Comparing the G channel of a movie frame and the corresponding power map (Figs. 4(a–b)) for the movie at the HR of this volunteer (1.06 Hz, power map is for a 23 s signal at 30 fps) shows relatively high powers in areas with high contrast. Under the assumption that movement artifacts mostly induce ‘white noise’ (no dominant frequency) around the HR frequency (as is plausible from the power spectrum for ROI III, Fig. 2(c)), we determine a ‘movement artifact map’ by averaging the powers at bandwidths around the HR. Such a map, (Fig. 4(c)) indicates that areas with high contrast (Fig. 4(a)) are indeed associated with high powers. After subtracting the movement artifact map from that in 4b, we obtain the map corrected for movement artifacts (Fig. 4(d). A range of better artifact reductions could be applied such as software to laterally synchronize the movie frame by frame. Such software is currently unavailable, however, and we used the described correction method as a preliminary attempt. All power maps shown herein are corrected in this way.

Fig. 4. (a) Still (G channel only) from a movie. (b) Corresponding power map (at HR=1.06 Hz) including artifactual high powers in areas with high contrast. (c) The movement artifact map consisting of average powers for bandwidths (0.80–0.95 and 1.17–1.33 Hz). (d) Artifact corrected map: map (b) minus map (c).

A critical look at the power map in Fig. 4(d) in comparison with the image in 4(a) suggests that the pulse power map correlates with the intensity of the G channel. Lighter areas in 4(a) often feature a higher pulse signal in 4(b), and vice versa. Until we have established better ways to deal with shading (due to facial curvature etc.) the presented power maps should not be interpreted as robust maps of relative pulsatilities. Nevertheless, in pulse amplitude maps of several PWS patients, we have often observed clear pulsatility contrasts between normal and adjacent PWS skin indicating the feasibility of plethysmographic imaging. In normal skin HR pulse amplitudes (G channel) were typically 2–4 times higher than in adjacent PWS skin: e.g. 0.75 and 0.25 PV, respectively.

3.4 Phase mapping

An example of mapping phase differences using plethysmographic imaging is shown in Fig. 5 and a movie (media 2). Figure 5(a) shows a still from a PWS patient who underwent laser therapy 5 minutes prior to the movie recording. Media 2 shows the PVBP(t) movie (BP filter: 0.8–6 Hz., G channel) of which excerpts (frames 9 and 22) are shown in Figs. 5(b) and (c). In Fig. 5b the PWS area has a higher intensity as compared to surrounding normal skin (note, this is true for the AC signal, the DC intensity is still lower) and Fig. 5(b) shows that 0.43 s later, the opposite is true. A phase map for the HR frequency of 1.43 Hz is shown in Fig. 5d. The approximate phases of the frames in Fig. 5(b,c) are indicated by the circle and triangle in Figs. 5(e,f). The Lissajous presentation (Fig. 5(f)) shows that the phase difference persists during the full 33 s. (43 heart beat cycles) of the movie recording. The Lissajous curve for the PWS signal shifted by 2 frames (Fig. 5(g)) shows that the phase difference can be quantified as approximately 0.067 s, or 34 degrees at a HR of 1.43 Hz.

Fig. 5. (a) Treated PWS area (dashed line) and 2 ROI (PWS and normal skin). (b-c) Frames 9 and 22, respectively, (Media 2). Intensities in (b–c) and Media 2 are linearly proportional to PVBP(t) (BP filter: 0.8–6 Hz). (d) Phase map (computed for 1.43 Hz) showing clear contrast between PWS and normal skin. (e) A fragment of the PVBP(t) signals in the ROI’s, dashed lines indicate the lowest points for the PWS signal occurring prior to those for the normal skin signal. (f,g) Lissajous presentations of these signals. The circle and triangle in (e,f) indicate the phases for the images in (b) and (c), respectively. (h) Power map, arrows illustrate areas with relatively low pulsatility surrounded by areas with high pulsatility.

Some areas in Fig. 5(h) can be identified as distinctly lower pulsatility (arrows) and correspond to areas that show some purpura (discoloration) due to laser therapy. Interestingly, they seem to be surrounded by areas with relatively higher pulsatility. The strong contrast between PWS and normal skin in the phase map (Fig. 5(d)) is remarkable, in particular when compared to the relative lack of contrast in the power map. To our knowledge such a phase difference in PWS has never been reported nor discussed in literature. We have not yet been able to explain these intriguing hemodynamic phenomena.

3.5 Cardio-vascular wave propagation

To illustrate interesting spatio-temporal features of the PPG signals and contrast between pulsatility in PWS and adjacent normal skin plethysmographic images are shown in Fig. 6 and media 3. The panels in Media 3 are (from left to right) PVBP(t) maps (BP filter: 0.8–2 Hz) for the R, G and B channels and the actual movie (reduced resolution), respectively. A movie excerpt from media 3 (t = 3.4 s, frame 103) is shown in Figs. 6(a–d). In the carotid artery area (neck to ear), the PVBP movies for each of the channels often appear to show an upward direction of relative intensity. We tentatively interpret this as the cardio-vascular wave. Although for most heart beats the periodic intensity variation is spread out laterally and lacks a clear definition of vascular structure, the arrow in Fig. 6(b) indicates a structure which may indeed be the carotid artery. The power maps for the full 30 s movie (Figs. 6(e–g)) average out the seemingly random lateral dispersion of the wave and show a similar longitudinal structure as indicated in Fig 6(b). This structure is best defined in the power map for the R channel (Fig. 6(e), arrow).

The phase map for the G channel (Fig. 6(h)) shows a small but distinct gradient (arrow) which corresponds to the general upward direction of the wave propagation displayed in Media 3. Although the carotid artery, presumably imaged in Figs. 6(e,f), is not visible on the phase map, a phase contrast between the general carotid artery area and the rest of the imaged face can be seen.

Fig. 6. (a–c) PVBP(t) for R, G and B channels, respectively and (d) the original movie, a screenshot of (Media 3) (t = 3.3 s.). (e–g) Corresponding power maps for R, G and B for the HR frequency (1.06 Hz) and the full 30 s. movie. Arrows in (b,e) indicate a structure which may be the right carotid artery. Arrows in (f,g) indicate displacement artifacts caused by the left carotid artery. (h) Phase map for the G channel, the arrow indicates a gradient of the phase.

In all three power maps (Figs. 6(e–g)) the relatively high powers in the lower right corner (arrows in Figs. 6(f,g)) are movement artifacts. In the original, non compressed movie, this area can be clearly seen to pulsate as the cardio-vascular waves propagate through the carotid artery. Even the adjacent hair moves synchronously. Since these displacements are clearly dominated by the HR, the described correction method (section 3.3) fails to remove these artifacts. Given the strong physical displacement of skin by the left carotid artery, we are aware that the relatively strong signals in the patient’s right carotid artery area may also be (partly) due to displacements. A slight displacement may easily modify the illumination (angle) of this area, synchronously with the HR. For a further discussion regarding the interpretation of these results see below.

4 Discussion

4.1 General

We have shown that movies of the human face, recorded with a simple digital camera and ambient light as the only source of illumination, contain robust reflectance PPG signals. Typically the G channel contains the strongest plethysmographic signal, consistent with the fact that (oxy-) hemoglobin absorbs green light better than red [15

15. E. van Kampen and W. Zijlstra, “Determination of hemoglobin and its derivatives,” in Advances in Clinical Chemistry, H. Sobotka and C. Stewart, eds. (Academic Press, New York, 1965), p. 158.

] and penetrates sufficiently deeper into the skin as compared to blue light to probe the vasculature. However, it should be noted that the R and B channels may contain complementary information (Fig. 3(d)). RR, HR, and their mutual modulation, can be determined (Figs. 13). Often, harmonics of the RR and HR are above the noise level which provides information regarding the shape of the plethysmograms. Lateral variations in pulsatility and phase of the cardio-vascular wave have been demonstrated in PWS (Figs. 5 and 6). With the expressed reservation, we believe that the carotid artery may have been imaged in one volunteer (Fig. 6(e)).

Two main issues limit the spatial resolution of the PPG images (power and phase) and accuracy of our current approach. First, movement artifacts and, second, reduced SNR due to CCD generated noise in the recorded pixel values. The first issue may be solvable by improved positioning of the volunteers (often the subjects were standing or sitting without head support), software to laterally synchronize frames and more homogeneous (artificial) illumination to reduce shading artifacts. The second issue may be abetted by simply using more advanced movie cameras with higher pixel resolution, allowing for a good SNR through pixel averaging while maintaining a good spatial resolution in the PPG images.

4.2 Artifacts

Although concerns regarding artifacts have been addressed in the results section, some require additional discussion. The movie of PVAC(t) (central panel in media 1) shows that the respiration signal of the cheek is out of phase with the rest of the face (e.g., compare frames for t = 7 and 10s). It is possible that the cheek area is slightly displaced during respiration, and, thus, modulating illumination. The overall RR signal, however, is most likely not artifactual. The RR signal for the three channels have different shapes (Fig. 3(d)) which is inconsistent with illumination/displacement artifacts. Moreover, the clear AC modulation of RR and HR also indicates that the overall RR signal is a true PPG signal. Shading has been acknowledged as a problem in PPG imaging and is being tackled by advanced technology [18

18. F. P. Wieringa, F. Mastik, F. J. ten Cate, H. A. M. Neumann, and A. F. W. van der Steen, “Remote non-invasive stereoscopic imaging of blood vessels: First in-vivo results of a new multispectral contrast enhancement technology,” Ann. Biomed. Eng. 34, 1870–1878 (2006). [CrossRef] [PubMed]

]. Obviously, our PPG imaging approach has yet to date not advanced to these dev elopmental stages.

A similar displacement artifact (now HR related) may underlie at least part of the strong signals in the right carotid artery area shown in Fig. 6. The fact that all three channels (R,G and B) feature a high power in Figs. 6(e–g) is consistent with this hypothesis. On the other hand, they do show some differential features. In particular, the map for the R channel, (a wavelength band closer to the wavelengths used for PPG imaging [2

2. F. P. Wieringa, F. Mastik, and A. F. W. van der Steen, “Contactless multiple wavelength photoplethysmographic imaging: A first step toward “SpO(2) camera” technology,” Ann. Biomed. Eng. 33, 1034–1041 (2005). [CrossRef] [PubMed]

]) appears to indicate a vessel like structure, exactly where the carotid artery is embedded. Even if some of the features in Fig. 6 are displacement artifacts it should be noted that they are basically true plethysmographic signals (measuring volume changes). In fact, tissue pulsatility measured with ultrasound [19

19. J. C. Kucewicz, B. Dunmire, N. D. Giardino, D. F. Leotta, M. Paun, S. R. Dager, and K. W. Beach, “Tissue pulsatility imaging of cerebral vasoreactivity during hyperventilation,” Ultrasound Med. Biol. 34, 1200–1208 (2008). [CrossRef] [PubMed]

] is plethysmography as well. However, the observed features may be not pure PPG as it is commonly understood.

4.3 Remote sensing

All herein presented plethysmographic signals were recorded without additional optical lenses other than the built-in 3x zoom. Since there is interest in remote sensing of HR for combat triage [20

20. S. Wendelken, S. McGrath, G. Blike, and M. Akay, “The feasibility of using a forehead reflectance pulse oximeter for automated remote triage,” in Bioengineering Conference, 2004. Proceedings of the IEEE 30th Annual Northeast, (2004), pp. 180–181.

] or for athletic monitoring purposes, we tried briefly to use a tele-lens (2x) in combination with one of our digital cameras. At a distance of 11 m between the camera and subject, the signal contained more noise than the signals in Fig. 1 but the fundamental HR frequency could still be identified very clearly for relatively short time windows of 10s. Using movie camera’s with stronger optical zoom options and higher pixel definitions, we expect to measure HR (and possibly RR) at greater distances than 11 m. This will be the subject of a future study.

4.4 Future directions

The strong signals in visible light are surprising in the sense that PPG plethysmography has been practiced for many decades while we found few studies exploiting this band, despite explicit recommendations by Crowe et al. [7

7. J. A. Crowe and D. Damianou, “The Wavelength Dependence of the Photoplethysmogram and its implication to Pulse Oximetry,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (Institute of Electrical and Electronics Engineers, NewYork, 1992), pp. 2423–2424.

] to use green/yellow light for which hemoglobin has absorption peaks [15

15. E. van Kampen and W. Zijlstra, “Determination of hemoglobin and its derivatives,” in Advances in Clinical Chemistry, H. Sobotka and C. Stewart, eds. (Academic Press, New York, 1965), p. 158.

] (consistent with our finding that the G channel has the strongest plethysmographic signals). This is perhaps due to the strong relationship between plethysmography and pulse oximetry. The latter has traditionally used red and IR wavelengths, one of which is at an isobestic point for oxy- and de-oxyhemoglobin. Although for pulse oximetry these wavelengths are probably the right choice, the demonstrated method has distinct opportunities in other applications. As Gailite [4

4. L. Gailite, J. Spigulis, and A. Lihachev, “Multilaser photoplethysmography technique,” Lasers Med. Sci. 23, 189–193 (2008). [CrossRef]

], Jonsson [21

21. A. Jonsson, “New sensor design made to discriminate between tissue blood flow at different tissue depths at the sacral area,” report #1098 (Mälardalen Research and Technology Centre, 2006).

] and Lindberg [6

6. L. G. Lindberg and P. A. Oberg, “Photoplethysmography II. Influence of light-source wavelength,” Med. Biol. Eng. Comput. 29, 48–54 (1991). [CrossRef] [PubMed]

] pointed out, reduction of the sampling depth using shorter wavelengths has advantages if superficial microvasculature rather than deeper vasculature is the focus of PPG. In our research to understand PWS and its response to laser therapy, this is indeed the case. We plan to use spectrally resolved reflectance models [16

16. W. Verkruysse, G. W. Lucassen, and M. J. C. van Gemert, “Simulation of color of port wine stain skin and its dependence on skin variables,” Lasers Surg. Med. 25, 131–139 (1999). [PubMed]

, 17

17. L. O. Svaasand, L. T. Norvang, E. J. Fiskerstrand, E. K. S. Stopps, M. W. Berns, and J. S. Nelson, “Tissue parameters determining the visual appearance of normal skin and port-wine stains,” Lasers Med. Sci. 10, 55–65 (1995). [CrossRef]

, 22

22. W. Verkruysse, G. W. Lucassen, J. F. de Boer, D. J. Smithies, J. S. Nelson, and M. J. C. van Gemert, “Modelling light distributions of homogeneous versus discrete absorbers in light irradiated turbid media,” Phys. Med. Biol. 42, 51–65 (1997). [CrossRef] [PubMed]

] and hemodynamic models [23

23. J. F. Gross, M. Intaglietta, and B. W. Zweifach, “Network model of pulsatile hemodynamics in the microcirculation of the rabbit omentum,” Am. J. Physiol.226, 1117–1123 (1974).

, 24

24. Y. L. Huo and G. S. Kassab, “Pulsatile blood flow in the entire coronary arterial tree: theory and experiment,” Am. J. Phys.-Heart Circul. Phys. 291, H1074–H1087 (2006).

] to understand the measured PPG signals’ relationship to PWS laser therapeutic outcome. Obviously, a more systematic categorization of PPG in PWS compared to adjacent skin as well as relative phase differences needs to be done. Currently, while improving the experimental conditions, we are in the process of designing such a study. Potentially this will reveal useful information, complementary to existing, but relatively complex methods to characterize hemodynamics of PWS such as laser speckle imaging [25

25. Y. C. Huang, T. L. Ringold, J. S. Nelson, and B. Choi, “Noninvasive blood flow imaging for real-time feedback during laser therapy of port wine stain birthmarks,” Lasers Surg. Med. 40167–173 (2008). [CrossRef] [PubMed]

], laser Doppler imaging [26

26. K. R. Forrester, C. Stewart, J. Tulip, C. Leonard, and R. C. Bray, “Comparison of laser speckle and laser Doppler perfusion imaging: measurement in human skin and rabbit articular tissue,” Med. Biol. Eng. Comput. 40, 687–697 (2002). [CrossRef]

] and Doppler optical coherence tomography [27

27. J. S. Nelson, K. M. Kelly, Y. H. Zhao, and Z. Chen, “Imaging blood flow in human port-wine stain in situ and in real time using optical Doppler tomography,” Arch. Dermatol. 137, 741–744 (2001). [PubMed]

]. In particular the relative phase differences (Fig. 6) and the differential plethysmogram shapes for PWS and normal skin are intriguing and show promise to help understand PWS hemodynamics beyond their current level.

All of the results in this manuscript concern measurements on the human face. Although we have measured clear PPG signals on other anatomical locations (e.g., wrist, leg) the facial signals were typically stronger, the forehead in particular. For the application of remote detection of vital signals for triage and sports this is helpful because the face is usually uncovered. A robust comparison of PPG signal strengths as a function of anatomical location is a subject for future investigation.

Acknowledgment

This work was made possible through the following NIH funds: AR47551 and EB2495.

References and links

1.

A. B. Hertzman and C. R. Spealman, “Observations on the finger volume pulse recorded photo-electrically,” Am. J. Physiol. 119, 334–335 (1937).

2.

F. P. Wieringa, F. Mastik, and A. F. W. van der Steen, “Contactless multiple wavelength photoplethysmographic imaging: A first step toward “SpO(2) camera” technology,” Ann. Biomed. Eng. 33, 1034–1041 (2005). [CrossRef] [PubMed]

3.

S. Hu, J. Zheng, V. Chouliaras, and R. Summers, “Feasibility of imaging photoplethysmography,” in Proceedings of the International Conference on BioMedical Engineering and Informatics, (Institute of Electrical and Electronics Engineers, NewYork, 2008), pp. 72–75.

4.

L. Gailite, J. Spigulis, and A. Lihachev, “Multilaser photoplethysmography technique,” Lasers Med. Sci. 23, 189–193 (2008). [CrossRef]

5.

A. Jonsson, “Pressure Sore Etiology - Highlighted with Optical Measurements of the Blood Flow,Chapter 3, New sensor design made to discriminate between tissue blood flow at different tissue depths at the sacral area,” PhD thesis (Mälardalen University Press, 2006).

6.

L. G. Lindberg and P. A. Oberg, “Photoplethysmography II. Influence of light-source wavelength,” Med. Biol. Eng. Comput. 29, 48–54 (1991). [CrossRef] [PubMed]

7.

J. A. Crowe and D. Damianou, “The Wavelength Dependence of the Photoplethysmogram and its implication to Pulse Oximetry,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (Institute of Electrical and Electronics Engineers, NewYork, 1992), pp. 2423–2424.

8.

P. Y. Cheang and P. R. Smith, “An Overview of Non-contact Photoplethysmography” (Department of Electronic and Electrical Engineering, Loughborough University, LE11 3TU, UK, 2003), retrieved August 27, 2008, http://www.lboro.ac.uk/departments/el/research/esc-miniconference/papers/cheang.pdf.

9.

J. A. Pollard, “Cardiac arrhythmias and pulse variability. A plethysmographic study,” Anaesthesia 25, 63–72 (1970). [CrossRef] [PubMed]

10.

H. D. Hummler, A. Engelmann, F. Pohlandt, J. Högel, and A. R. Franz, “Accuracy of pulse oximetry readings in an animal model of low perfusion caused by emerging pneumonia and sepsis,” Intensive. Care. Med. 30, 709–713 (2004). [CrossRef] [PubMed]

11.

N. S. Trivedi, A. F. Ghouri, N. K. Shah, E. Lai, and S. J. Barker, “Effects of motion, ambient light, and hypoperfusion on pulse oximeter function,” J. Clin. Anesth. 9, 179–183 (1997). [CrossRef] [PubMed]

12.

S. H. Barsky, S. Rosen, D. E. Geer, and J. M. Noe, “The nature and evolution of port wine stains: A computer-assisted study,” J. Invest. Dermatol. 74, 154–157 (1980). [CrossRef] [PubMed]

13.

J. Allen, “Photoplethysmography and its application in clinical physiological measurement,” Physiol. Meas. 28, R1–R39 (2007). [CrossRef] [PubMed]

14.

M. J. Ford, M. J. Camilleri, R. B. Hanson, J. A. Wiste, and M. J. Joyner, “Hyperventilation, central autonomic control, and colonic tone in humans,” Gut 37, 499–504 (1995). [CrossRef] [PubMed]

15.

E. van Kampen and W. Zijlstra, “Determination of hemoglobin and its derivatives,” in Advances in Clinical Chemistry, H. Sobotka and C. Stewart, eds. (Academic Press, New York, 1965), p. 158.

16.

W. Verkruysse, G. W. Lucassen, and M. J. C. van Gemert, “Simulation of color of port wine stain skin and its dependence on skin variables,” Lasers Surg. Med. 25, 131–139 (1999). [PubMed]

17.

L. O. Svaasand, L. T. Norvang, E. J. Fiskerstrand, E. K. S. Stopps, M. W. Berns, and J. S. Nelson, “Tissue parameters determining the visual appearance of normal skin and port-wine stains,” Lasers Med. Sci. 10, 55–65 (1995). [CrossRef]

18.

F. P. Wieringa, F. Mastik, F. J. ten Cate, H. A. M. Neumann, and A. F. W. van der Steen, “Remote non-invasive stereoscopic imaging of blood vessels: First in-vivo results of a new multispectral contrast enhancement technology,” Ann. Biomed. Eng. 34, 1870–1878 (2006). [CrossRef] [PubMed]

19.

J. C. Kucewicz, B. Dunmire, N. D. Giardino, D. F. Leotta, M. Paun, S. R. Dager, and K. W. Beach, “Tissue pulsatility imaging of cerebral vasoreactivity during hyperventilation,” Ultrasound Med. Biol. 34, 1200–1208 (2008). [CrossRef] [PubMed]

20.

S. Wendelken, S. McGrath, G. Blike, and M. Akay, “The feasibility of using a forehead reflectance pulse oximeter for automated remote triage,” in Bioengineering Conference, 2004. Proceedings of the IEEE 30th Annual Northeast, (2004), pp. 180–181.

21.

A. Jonsson, “New sensor design made to discriminate between tissue blood flow at different tissue depths at the sacral area,” report #1098 (Mälardalen Research and Technology Centre, 2006).

22.

W. Verkruysse, G. W. Lucassen, J. F. de Boer, D. J. Smithies, J. S. Nelson, and M. J. C. van Gemert, “Modelling light distributions of homogeneous versus discrete absorbers in light irradiated turbid media,” Phys. Med. Biol. 42, 51–65 (1997). [CrossRef] [PubMed]

23.

J. F. Gross, M. Intaglietta, and B. W. Zweifach, “Network model of pulsatile hemodynamics in the microcirculation of the rabbit omentum,” Am. J. Physiol.226, 1117–1123 (1974).

24.

Y. L. Huo and G. S. Kassab, “Pulsatile blood flow in the entire coronary arterial tree: theory and experiment,” Am. J. Phys.-Heart Circul. Phys. 291, H1074–H1087 (2006).

25.

Y. C. Huang, T. L. Ringold, J. S. Nelson, and B. Choi, “Noninvasive blood flow imaging for real-time feedback during laser therapy of port wine stain birthmarks,” Lasers Surg. Med. 40167–173 (2008). [CrossRef] [PubMed]

26.

K. R. Forrester, C. Stewart, J. Tulip, C. Leonard, and R. C. Bray, “Comparison of laser speckle and laser Doppler perfusion imaging: measurement in human skin and rabbit articular tissue,” Med. Biol. Eng. Comput. 40, 687–697 (2002). [CrossRef]

27.

J. S. Nelson, K. M. Kelly, Y. H. Zhao, and Z. Chen, “Imaging blood flow in human port-wine stain in situ and in real time using optical Doppler tomography,” Arch. Dermatol. 137, 741–744 (2001). [PubMed]

OCIS Codes
(170.3880) Medical optics and biotechnology : Medical and biological imaging
(280.4991) Remote sensing and sensors : Passive remote sensing

ToC Category:
Medical Optics and Biotechnology

History
Original Manuscript: October 15, 2008
Revised Manuscript: November 21, 2008
Manuscript Accepted: December 9, 2008
Published: December 12, 2008

Virtual Issues
Vol. 4, Iss. 2 Virtual Journal for Biomedical Optics

Citation
Wim Verkruysse, Lars O. Svaasand, and J. S. Nelson, "Remote plethysmographic imaging using ambient light," Opt. Express 16, 21434-21445 (2008)
http://www.opticsinfobase.org/vjbo/abstract.cfm?URI=oe-16-26-21434


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. A. B. Hertzman and C. R. Spealman, "Observations on the finger volume pulse recorded photo-electrically," Am. J. Physiol. 119, 334-335 (1937).
  2. F. P. Wieringa, F. Mastik, and A. F. W. van der Steen, "Contactless multiple wavelength photoplethysmographic imaging: A first step toward "SpO(2) camera" technology," Ann. Biomed. Eng. 33, 1034-1041 (2005). [CrossRef] [PubMed]
  3. S. Hu, J. Zheng, V. Chouliaras, and R. Summers, "Feasibility of imaging photoplethysmography," in Proceedings of the International Conference on BioMedical Engineering and Informatics, (Institute of Electrical and Electronics Engineers, NewYork, 2008), pp. 72-75.
  4. L. Gailite, J. Spigulis, and A. Lihachev, "Multilaser photoplethysmography technique," Lasers Med. Sci. 23, 189-193 (2008). [CrossRef]
  5. A. Jonsson, "Pressure Sore Etiology - Highlighted with Optical Measurements of the Blood Flow, Chapter 3, New sensor design made to discriminate between tissue blood flow at different tissue depths at the sacral area," PhD thesis (Mälardalen University Press, 2006).
  6. L. G. Lindberg and P. A. Oberg, "Photoplethysmography II. Influence of light-source wavelength," Med. Biol. Eng. Comput. 29, 48-54 (1991). [CrossRef] [PubMed]
  7. J. A. Crowe and D. Damianou, "The Wavelength Dependence of the Photoplethysmogram and its implication to Pulse Oximetry," in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (Institute of Electrical and Electronics Engineers, NewYork, 1992), pp. 2423-2424.
  8. P. Y. Cheang and P. R. Smith, "An Overview of Non-contact Photoplethysmography" (Department of Electronic and Electrical Engineering, Loughborough University, LE11 3TU, UK, 2003), retrieved August 27, 2008, http://www.lboro.ac.uk/departments/el/research/esc-miniconference/papers/cheang.pdf
  9. J. A. Pollard, "Cardiac arrhythmias and pulse variability. A plethysmographic study," Anaesthesia 25, 63-72 (1970). [CrossRef] [PubMed]
  10. H. D. Hummler, A. Engelmann, F. Pohlandt, J. Högel, and A. R. Franz, "Accuracy of pulse oximetry readings in an animal model of low perfusion caused by emerging pneumonia and sepsis," Intensive. Care. Med. 30, 709-713 (2004). [CrossRef] [PubMed]
  11. N. S. Trivedi, A. F. Ghouri, N. K. Shah, E. Lai, and S. J. Barker, "Effects of motion, ambient light, and hypoperfusion on pulse oximeter function," J. Clin. Anesth. 9, 179-183 (1997). [CrossRef] [PubMed]
  12. S. H. Barsky, S. Rosen, D. E. Geer, and J. M. Noe, "The nature and evolution of port wine stains: A computer-assisted study," J. Invest. Dermatol. 74, 154-157 (1980). [CrossRef] [PubMed]
  13. J. Allen, "Photoplethysmography and its application in clinical physiological measurement," Physiol. Meas. 28, R1-R39 (2007). [CrossRef] [PubMed]
  14. M. J. Ford, M. J. Camilleri, R. B. Hanson, J. A. Wiste, and M. J. Joyner, "Hyperventilation, central autonomic control, and colonic tone in humans," Gut 37, 499-504 (1995). [CrossRef] [PubMed]
  15. E. van Kampen and W. Zijlstra, "Determination of hemoglobin and its derivatives," in Advances in Clinical Chemistry, H. Sobotka, and C. Stewart, eds., (Academic Press, New York, 1965), p. 158.
  16. W. Verkruysse, G. W. Lucassen, and M. J. C. van Gemert, "Simulation of color of port wine stain skin and its dependence on skin variables," Lasers Surg. Med. 25, 131-139 (1999). [PubMed]
  17. L. O. Svaasand, L. T. Norvang, E. J. Fiskerstrand, E. K. S. Stopps, M. W. Berns, and J. S. Nelson, "Tissue parameters determining the visual appearance of normal skin and port-wine stains," Lasers Med. Sci. 10, 55-65 (1995). [CrossRef]
  18. F. P. Wieringa, F. Mastik, F. J. ten Cate, H. A. M. Neumann, and A. F. W. van der Steen, "Remote non-invasive stereoscopic imaging of blood vessels: First in-vivo results of a new multispectral contrast enhancement technology," Ann. Biomed. Eng. 34, 1870-1878 (2006). [CrossRef] [PubMed]
  19. J. C. Kucewicz, B. Dunmire, N. D. Giardino, D. F. Leotta, M. Paun, S. R. Dager, and K. W. Beach, "Tissue pulsatility imaging of cerebral vasoreactivity during hyperventilation," Ultrasound Med. Biol. 34, 1200-1208 (2008). [CrossRef] [PubMed]
  20. S. Wendelken, S. McGrath, G. Blike, and M. Akay, "The feasibility of using a forehead reflectance pulse oximeter for automated remote triage," in Bioengineering Conference, 2004. Proceedings of the IEEE 30th Annual Northeast, (2004), pp. 180-181.
  21. A. Jonsson, "New sensor design made to discriminate between tissue blood flow at different tissue depths at the sacral area," report #1098 (Mälardalen Research and Technology Centre, 2006).
  22. W. Verkruysse, G. W. Lucassen, J. F. de Boer, D. J. Smithies, J. S. Nelson, and M. J. C. van Gemert, "Modelling light distributions of homogeneous versus discrete absorbers in light irradiated turbid media," Phys. Med. Biol. 42, 51-65 (1997). [CrossRef] [PubMed]
  23. J. F. Gross, M. Intaglietta, and B. W. Zweifach, "Network model of pulsatile hemodynamics in the microcirculation of the rabbit omentum," Am. J. Physiol. 226, 1117-1123 (1974).
  24. Y. L. Huo and G. S. Kassab, "Pulsatile blood flow in the entire coronary arterial tree: theory and experiment," Am. J. Phys.-Heart Circul. Phys. 291, H1074-H1087 (2006).
  25. Y. C. Huang, T. L. Ringold, J. S. Nelson, and B. Choi, "Noninvasive blood flow imaging for real-time feedback during laser therapy of port wine stain birthmarks," Lasers Surg. Med. 40, 167-173 (2008). [CrossRef] [PubMed]
  26. K. R. Forrester, C. Stewart, J. Tulip, C. Leonard, and R. C. Bray, "Comparison of laser speckle and laser Doppler perfusion imaging: measurement in human skin and rabbit articular tissue," Med. Biol. Eng. Comput. 40, 687-697 (2002). [CrossRef]
  27. J. S. Nelson, K. M. Kelly, Y. H. Zhao, and Z. Chen, "Imaging blood flow in human port-wine stain in situ and in real time using optical Doppler tomography," Arch. Dermatol. 137, 741-744 (2001). [PubMed]

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Supplementary Material


» Media 1: MPG (4267 KB)     
» Media 2: MPG (2436 KB)     
» Media 3: MPG (3786 KB)     

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited