OSA's Digital Library

Applied Optics

Applied Optics


  • Editor: James C. Wyant
  • Vol. 47, Iss. 3 — Jan. 20, 2008
  • pp: 317–327

Dual-sensor foveated imaging system

Hong Hua and Sheng Liu  »View Author Affiliations

Applied Optics, Vol. 47, Issue 3, pp. 317-327 (2008)

View Full Text Article

Enhanced HTML    Acrobat PDF (3811 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



Conventional imaging techniques adopt a rectilinear sampling approach, where a finite number of pixels are spread evenly across an entire field of view (FOV). Consequently, their imaging capabilities are limited by an inherent trade-off between the FOV and the resolving power. In contrast, a foveation technique allocates the limited resources (e.g., a finite number of pixels or transmission bandwidth) as a function of foveal eccentricities, which can significantly simplify the optical and electronic designs and reduce the data throughput, while the observer's ability to see fine details is maintained over the whole FOV. We explore an approach to a foveated imaging system design. Our approach approximates the spatially variant properties (i.e., resolution, contrast, and color sensitivities) of the human visual system with multiple low-cost off-the-shelf imaging sensors and maximizes the information throughput and bandwidth savings of the foveated system. We further validate our approach with the design of a compact dual-sensor foveated imaging system. A proof-of-concept bench prototype and experimental results are demonstrated.

© 2008 Optical Society of America

OCIS Codes
(110.0110) Imaging systems : Imaging systems
(220.4830) Optical design and fabrication : Systems design
(330.1800) Vision, color, and visual optics : Vision - contrast sensitivity
(230.4685) Optical devices : Optical microelectromechanical devices
(330.7338) Vision, color, and visual optics : Visually coupled optical systems

ToC Category:
Imaging Systems

Original Manuscript: September 25, 2007
Revised Manuscript: November 16, 2007
Manuscript Accepted: November 17, 2007
Published: January 14, 2008

Virtual Issues
Vol. 3, Iss. 2 Virtual Journal for Biomedical Optics

Hong Hua and Sheng Liu, "Dual-sensor foveated imaging system," Appl. Opt. 47, 317-327 (2008)

Sort:  Year  |  Journal  |  Reset  


  1. G. Scotti, L. Marcenaro, C. Coelho, F. Selvaggi, and C. S. Regazzoni, "Dual camera intelligent sensor for high definition 360 degrees surveillance," IEE Proc. Vision Image Signal Process. 152, 250-257 (2005). [CrossRef]
  2. T. Ienaga, K. Matsunaga, K. Shidoji, K. Goshi, Y. Matsuki, and H. Nagata, "Stereoscopic video system with embedded high spatial resolution images using two channels for transmission," in Proceedings of ACM Symposium on Virtual Reality Software and Technology (2001), pp. 111-118. [CrossRef]
  3. A. Ude, C. Gaskett, and G. Cheng, "Foveated vision systems with two cameras per eye," in Proceedings of IEEE International Conference on Robotics and Automation (IEEE, 2006), pp. 3457-3462.
  4. C. Wang, P. Shumyatsky, F. Zeng, M. Zevallos, and R. R. Alfano, "Computer-controlled optical scanning tile microscope," Appl. Opt. 45, 1148-1152 (2006). [CrossRef] [PubMed]
  5. B. Potsaid, Y. Bellouard, and J. T. Wen, "Adaptive scanning optical microscope (ASOM): a multidisciplinary optical microscope design for large field of view and high resolution imaging," Opt. Express 13, 6504-6518 (2005). [CrossRef] [PubMed]
  6. M. Böhme, M. Dorr, T. Martinetz, and E. Barth, "Gaze-contingent temporal filtering of video," in Proceedings of ACM Symposium on Eye Tracking Research & Applications (2006), pp. 109-116. [CrossRef]
  7. W. Zhou and A. C. Bovik, "Embedded foveation image coding," IEEE Trans. Image Process. 10, 1397-1410 (2001). [CrossRef]
  8. W. S. Geisler and J. S. Perry, "Real-time foveated multiresolution system for low-bandwidth video communication," Proc. SPIE 3299, 294-305 (1998). [CrossRef]
  9. A. T. Duchowski and A. Çöltekin, "Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging," ACM Trans. Multimedia Comput. Commun. Appl. 3, 1-21 (2007). [CrossRef]
  10. H. Murphy and A. T. Duchowski, "Hybrid image-/model-based gaze-contingent rendering," in Proceedings of ACM Symposium on Applied Perception in Graphics and Visualization (2007), pp. 1-8.
  11. D. Luebke and B. Hallen, "Perceptually driven simplification for interactive rendering," in Proceedings of the 2001 Eurographics Workshop on Rendering (2001), pp. 223-234. [CrossRef]
  12. G. Sandini, P. Questa, D. Scheffer, and A. Mannucci, "A retina-like CMOS sensor and its applications," in Proceedings of IEEE Workshop on Sensor Array and Multichannel Signal Processing (IEEE, 2000), pp. 514-519.
  13. J. P. Rolland, A. Yoshida, L. D. Davis, and J. H. Reif, "High-resolution inset head-mounted display," Appl. Opt. 37, 4183-4193 (1998). [CrossRef]
  14. D. V. Wick, T. Martinez, S. R. Restaino, and B. R. Stone, "Foveated imaging demonstration," Opt. Express 10, 60-65 (2002). [PubMed]
  15. T. Martinez, D. V. Wick, and S. R. Restaino, "Foveated, wide field-of-view imaging system using a liquid crystal spatial light modulator," Opt. Express 8, 555-560 (2001). [CrossRef] [PubMed]
  16. E. M. Reingold, L. C. Loschky, G. W. McConkie, and D. M. Stampe, "Gaze-contingent multiresolutional displays: an integrative review," Hum. Factors 45, 307-328 (2003). [CrossRef] [PubMed]
  17. L. C. Loschky and G. S. Wolverton, "How late can you update gaze-contingent multiresolutional displays without detection?," ACM Trans. Multimedia Comput. Commun. Appl. 3 (2007). [CrossRef]
  18. W. S. Geisler, J. S. Perry, and J. Najemnik, "Visual search: the role of peripheral information measured using gaze-contingent displays," J. Vision 6, 858-873 (2006). [CrossRef]
  19. L. C. Loschky, G. W. McConkie, H. Yang, and M. E. Miller, "The limits of visual resolution in natural scene viewing," Visual Cognition 12, 1057-1092 (2005). [CrossRef]
  20. M. Dorr, M. Böhme, T. Martinetz, and E. Barth, "Visibility of temporal blur on a gaze-contingent display," in Proceedings of the ACM Symposium on Applied Perception, Graphics & Visualization (2005), pp. 33-36.
  21. D. J. Parkhurst and E. Niebur, "Variable-resolution displays: a theoretical, practical, and behavioural evaluation," Hum. Factors 44, 611-629 (2002). [CrossRef]
  22. L. C. Loschky and G. W. McConkie, "Investigating spatial vision and dynamic attentional selection using a gaze-contingent multiresolutional display," Q. J. Exp. Psychol. A 8, 99-117 (2002).
  23. R. Etienne-Cummings, J. Van der Spiegel, P. Mueller, and M. Z. Zhang, "A foveated silicon retina for two-dimensional tracking," IEEE Trans. Circuits Syst. II 47, 504-517 (2000). [CrossRef]
  24. G. Godin, P. Massicotte, and L. Borgeat, "High-resolution insets in projector-based stereoscopic displays: principles and techniques," Proc. SPIE 6055, 60550F (2006). [CrossRef]
  25. S. J. D. Prince, J. H. Elder, Y. Hou, and M. Sizinstev, "Pre-attentive face detection for foveated wide-field surveillance," in IEEE Workshops on Application of Computer Vision (IEEE, 2005), pp. 439-446.
  26. Peter G. J. Barten, Contrast Sensitivity of the Human Eye and Its Effects on Image Quality (SPIE Optical Engineering Press, 1999). [CrossRef]
  27. C. Gao, N. Ahuja, and H. Hua, "Active aperture control and sensor modulation for flexible imaging," in Proceedings of International Conference on Computer Vision and Pattern Recognition (2007).
  28. J. E. Greivenkamp, Field Guide to Geometrical Optics (SPIE Press, 2004). [CrossRef]
  29. Camera calibration toolbox, http://www.vision.caltech.edu/bouguetj/calib_doc/index.html.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited