OSA's Digital Library

Optics Express

Optics Express

  • Editor: C. Martijn de Sterke
  • Vol. 18, Iss. 10 — May. 10, 2010
  • pp: 10762–10774

Optics InfoBase > Optics Express > Volume 18 > Issue 10 > Page 10762

Non-contact, automated cardiac pulse measurements using video imaging and blind source separation

Ming-Zher Poh, Daniel J. McDuff, and Rosalind W. Picard  »View Author Affiliations


Optics Express, Vol. 18, Issue 10, pp. 10762-10774 (2010)
http://dx.doi.org/10.1364/OE.18.010762


View Full Text Article

Enhanced HTML    Acrobat PDF (2182 KB)


Advanced Search

Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Remote measurements of the cardiac pulse can provide comfortable physiological assessment without electrodes. However, attempts so far are non-automated, susceptible to motion artifacts and typically expensive. In this paper, we introduce a new methodology that overcomes these problems. This novel approach can be applied to color video recordings of the human face and is based on automatic face tracking along with blind source separation of the color channels into independent components. Using Bland-Altman and correlation analysis, we compared the cardiac pulse rate extracted from videos recorded by a basic webcam to an FDA-approved finger blood volume pulse (BVP) sensor and achieved high accuracy and correlation even in the presence of movement artifacts. Furthermore, we applied this technique to perform heart rate measurements from three participants simultaneously. This is the first demonstration of a low-cost accurate video-based method for contact-free heart rate measurements that is automated, motion-tolerant and capable of performing concomitant measurements on more than one person at a time.

© 2010 OSA

OCIS Codes
(170.0170) Medical optics and biotechnology : Medical optics and biotechnology
(280.0280) Remote sensing and sensors : Remote sensing and sensors

ToC Category:
Medical Optics and Biotechnology

History
Original Manuscript: February 12, 2010
Revised Manuscript: April 30, 2010
Manuscript Accepted: May 6, 2010
Published: May 7, 2010

Virtual Issues
Vol. 5, Iss. 9 Virtual Journal for Biomedical Optics

Citation
Ming-Zher Poh, Daniel J. McDuff, and Rosalind W. Picard, "Non-contact, automated cardiac pulse measurements using video imaging and blind source separation," Opt. Express 18, 10762-10774 (2010)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-18-10-10762


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. S. Cook, M. Togni, M. C. Schaub, P. Wenaweser, and O. M. Hess, “High heart rate: a cardiovascular risk factor?” Eur. Heart J. 27(20), 2387–2393 (2006). [CrossRef] [PubMed]
  2. I. Pavlidis, J. Dowdall, N. Sun, C. Puri, J. Fei, and M. Garbey, “Interacting with human physiology,” Comput. Vis. Image Underst. 108(1-2), 150–170 (2007). [CrossRef]
  3. M. Garbey, N. Sun, A. Merla, and I. Pavlidis, “Contact-free measurement of cardiac pulse based on the analysis of thermal imagery,” IEEE Trans. Biomed. Eng. 54(8), 1418–1426 (2007). [CrossRef] [PubMed]
  4. J. Fei and I. Pavlidis, “Thermistor at a Distance: Unobtrusive Measurement of Breathing,” IEEE Trans. Biomed. Eng. 57(4), 988–998 (2010). [CrossRef]
  5. F. P. Wieringa, F. Mastik, and A. F. van der Steen, “Contactless multiple wavelength photoplethysmographic imaging: a first step toward “SpO2 camera” technology,” Ann. Biomed. Eng. 33(8), 1034–1041 (2005). [CrossRef] [PubMed]
  6. K. Humphreys, T. Ward, and C. Markham, “Noncontact simultaneous dual wavelength photoplethysmography: a further step toward noncontact pulse oximetry,” Rev. Sci. Instrum. 78(4), 044304 (2007). [CrossRef] [PubMed]
  7. C. Takano and Y. Ohta, “Heart rate measurement based on a time-lapse image,” Med. Eng. Phys. 29(8), 853–857 (2007). [CrossRef]
  8. S. Hu, J. Zheng, V. Chouliaras, and R. Summers, “Feasibility of imaging photoplethysmography,” in Proceedings of IEEE Conference on BioMedical Engineering and Informatics (IEEE, 2008), pp. 72–75.
  9. W. Verkruysse, L. O. Svaasand, and J. S. Nelson, “Remote plethysmographic imaging using ambient light,” Opt. Express 16(26), 21434–21445 (2008). [CrossRef] [PubMed]
  10. J. Allen, “Photoplethysmography and its application in clinical physiological measurement,” Physiol. Meas. 28(3), R1–R39 (2007). [CrossRef] [PubMed]
  11. S. Rhee, B. H. Yang, and H. H. Asada, “Artifact-resistant power-efficient design of finger-ring plethysmographic sensors,” IEEE Trans. Biomed. Eng. 48(7), 795–805 (2001). [CrossRef] [PubMed]
  12. M. Z. Poh, N. C. Swenson, and R. Picard, “Motion-tolerant magnetic earring sensor and wireless earpiece for wearable photoplethysmography,” IEEE Trans Inf Technol Biomed (Epub 2010 Feb).
  13. P. Comon, “Independent component analysis, a new concept?” Signal Process. 36(3), 287–314 (1994). [CrossRef]
  14. C. J. James and C. W. Hesse, “Independent component analysis for biomedical signals,” Physiol. Meas. 26(1), R15–R39 (2005). [CrossRef] [PubMed]
  15. M. P. Chawla, H. K. Verma, and V. Kumar, “Artifacts and noise removal in electrocardiograms using independent component analysis,” Int. J. Cardiol. 129(2), 278–281 (2008). [CrossRef]
  16. T. P. Jung, S. Makeig, C. Humphries, T. W. Lee, M. J. McKeown, V. Iragui, and T. J. Sejnowski, “Removing electroencephalographic artifacts by blind source separation,” Psychophysiology 37(2), 163–178 (2000). [CrossRef] [PubMed]
  17. J.-F. Cardoso, “Multidimensional independent component analysis,” in Proceedings of IEEE Conference on Acoustics, Speech and Signal Processing (IEEE, 1998), pp. 1941–1944.
  18. M. J. McKeown, S. Makeig, G. G. Brown, T.-P. Jung, S. S. Kindermann, A. J. Bell, and T. J. Sejnowski, “Analysis of fMRI data by blind separation into independent spatial components,” Hum. Brain Mapp. 6(3), 160–188 (1998). [CrossRef] [PubMed]
  19. Y. Jianchu, and S. Warren, “A Short Study to Assess the Potential of Independent Component Analysis for Motion Artifact Separation in Wearable Pulse Oximeter Signals,” in Proceedings of IEEE Conference of the Engineering in Medicine and Biology Society (IEEE, 2005), pp. 3585–3588.
  20. B. S. Kim and S. K. Yoo, “Motion artifact reduction in photoplethysmography using independent component analysis,” IEEE Trans. Biomed. Eng. 53(3), 566–568 (2006). [CrossRef] [PubMed]
  21. W. G. Zijlstra, A. Buursma, and W. P. Meeuwsen-van der Roest, “Absorption spectra of human fetal and adult oxyhemoglobin, de-oxyhemoglobin, carboxyhemoglobin, and methemoglobin,” Clin. Chem. 37(9), 1633–1638 (1991). [PubMed]
  22. H. Trotter, “An elementary proof of the central limit theorem,” Arch. Math. 10(1), 226–234 (1959). [CrossRef]
  23. A. Noulas, and B. Krӧse, “EM detection of common origin of multi-modal cues,” in Proceedings of ACM Conference on Multimodal Interfaces (ACM, 2006), pp. 201–208.
  24. P. Viola, and M. Jones, “Rapid object detection using a boosted cascade of simple features,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2001), p. 511.
  25. R. Lienhart, and J. Maydt, “An extended set of Haar-like features for rapid object detection,” in Proceedings of IEEE Conference on Image Processing (IEEE, 2002).
  26. J.-F. Cardoso, “High-order contrasts for independent component analysis,” Neural Comput. 11(1), 157–192 (1999). [CrossRef] [PubMed]
  27. J. M. Bland and D. G. Altman, “Statistical methods for assessing agreement between two methods of clinical measurement,” Lancet 1(8476), 307–310 (1986). [CrossRef] [PubMed]
  28. R. C. Wuerz, D. Travers, N. Gilboy, D. R. Eitel, A. Rosenau, and R. Yazhari, “Implementation and refinement of the emergency severity index,” Acad. Emerg. Med. 8(2), 170–176 (2001). [CrossRef] [PubMed]
  29. S. Munder and D. M. Gavrila, “An experimental study on pedestrian classification,” IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1863–1868 (2006). [CrossRef] [PubMed]
  30. B. Heisele, T. Serre, and T. Poggio, “A component-based framework for face detection and identification,” Int. J. Comput. Vis. 74(2), 167–181 (2007). [CrossRef]
  31. H.-Y. Chen, C.-L. Huang, and C.-M. Fu, “Hybrid-boost learning for multi-pose face detection and facial expression recognition,” Pattern Recognit. 41(3), 1173–1185 (2008). [CrossRef]
  32. W. J. Cui, L. E. Ostrander, and B. Y. Lee, “In vivo reflectance of blood and tissue as a function of light wavelength,” IEEE Trans. Biomed. Eng. 37(6), 632–639 (1990). [CrossRef] [PubMed]

Cited By

 Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Multimedia

Multimedia FilesRecommended Software
» Media 1: MOV (1153 KB)      QuickTime
» Media 2: MOV (1763 KB)      QuickTime
» Media 3: MOV (2500 KB)      QuickTime

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited