OSA's Digital Library

Journal of Display Technology

Journal of Display Technology


  • Vol. 10, Iss. 8 — Aug. 1, 2014
  • pp: 647–659

Transforming a Regular Screen Into a Touch Screen Using a Single Webcam

Longyu Zhang, Jamal Saboune, and Abdulmotaleb El Saddik

Journal of Display Technology, Vol. 10, Issue 8, pp. 647-659 (2014)

View Full Text Article

Acrobat PDF (1803 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

  • Export Citation/Save Click for help


Nowadays, touch screens are widely used in many commercial devices. In this paper, we present an inexpensive webcam-based touch screen system based on a simple and generic finger detection technique. Only a single webcam and a regular screen are used to achieve this goal. By using the scene geometry and the camera model, we can determine the position of the finger on the screen. The technique we propose is simple and works well under various surrounding environments while the detecting method suits many finger colors and shapes. Our approach can also be used for realtime applications. Experimental results and practical applications are provided to ascertain the proposed method.

© 2014 IEEE

Longyu Zhang, Jamal Saboune, and Abdulmotaleb El Saddik, "Transforming a Regular Screen Into a Touch Screen Using a Single Webcam," J. Display Technol. 10, 647-659 (2014)

Sort:  Year  |  Journal  |  Reset


  1. M. P. Hoang, T. D. Nguyen, T. M. Hoang, "Implementation of webcam-based touchscreen," 2010 3rd Int. Conf. on Commun. Electron. (ICCE) (2010) pp. 201-206.
  2. K. T. R. Phares, Resistive touchscreen having multiple selectable regions for pressure discrimination U.S. Patent 5 815 141 (1998).
  3. D. O. Robert, G. Kable, C. O. Philip, A. Schlosser, Electrographic apparatus U.S. Patent 4 665 283 (1987).
  4. L. Xu, Infrared touch screen U.S. Patent Appl. 2011/0115748 A1 (2011).
  5. K. Cheng, M. Takatsuka, "Initial evaluation of a bare-hand interaction technique for large displays using a webcam," Proc. 1st ACM SIGCHI Symp. on Eng. Interactive Computing Syst. (2009) pp. 291-296.
  6. Z. Zhang, Y. Shan, "Visual screen: Transforming an ordinary screen into a touch screen," Proc. IAPR Workshop on Mach. Vision Appl. (2000) pp. 215-218.
  7. Y. Zhou, G. Morrison, "A real-time algorithm for finger detection in a camera based finger-friendly interactive board system," 5th Int. Conf. on Computer Vision Syst. (2007) pp. 21-24.
  8. X. Wang, X. Zhang, G. Dai, "Tracking of deformable human hand in real time as continuous input for gesture-based interaction," Proc. 12th Int.. Conf. on Intelligent User Interfaces (IUI '07) (2007) pp. 235-242.
  9. S. K. Kang, M. Y. Nam, P. K. Rhee, "Color based hand and finger detection technology for user interaction," 2008. Int.. Conf. on Convergence and Hybrid Inform. Technol. (ICHIT '08) (2008) pp. 229-236.
  10. D. Lee, Y. Park, "Vision-based remote control system by motion detection and open finger counting," IEEE Trans. Consumer Electron. 55, 2308-2313 (2009).
  11. L.-G. Zhang, Y. Chen, G. Fang, X. Chen, W. Gao, "A vision-based sign language recognition system using tied-mixture density hmm," Proc. 6th Int.. Conf. on Multimodal Interfaces (ICMI '04) (2004) pp. 198-204.
  12. A. Anagnostopoulos, A. Pnevmatikakis, "A realtime mixed reality system for seamless interaction between real and virtual objects," Proc. 3rd Int.. Conf. on Digital Interactive Media in Entertainment and Arts (DIMEA '08) (2008) pp. 199-204.
  13. L.-W. Chan, Y.-F. Chuang, M.-C. Yu, Y.-L. Chao, M.-S. Lee, Y.-P. Hung, J. Hsu, "Gesture-based interaction for a magic crystal ball," Proc. 2007 ACM Symp. on Virtual Reality Software and Technol. (VRST '07) (2007) pp. 157-164.
  14. D. O. Gorodnichy, A. Yogeswaran, "Detection and tracking of pianist hands and fingers," Proc. 3rd Can. Conf. Computer and Robot Vision (2006).
  15. R. Anchini, C. Liguori, V. Paciello, A. Paolillo, "A comparison between stereo-vision techniques for the reconstruction of 3-D coordinates of objects," IEEE Trans. Instrum. Meas. 55, 1459-1466 (2006).
  16. C.-H. Su, H.-S. Chiu, T.-M. Hsieh, "An efficient image retrieval based on HSV color space," 2011 Int.. Conf. on Elect. Control Eng. (ICECE) (2011) pp. 5746-5749.
  17. Lifecam HD5001 (2013) http://www.microsoft.com/hardware/en-us/p/lifecam-hd-5001/GNF-00001.
  18. OpenCV (2013) http://opencv.willowgarage.com/wiki.
  19. Vitruvian Man (2013) http://en.wikipedia.org/wiki/Vitruvian_Man.

Cited By

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited