OSA's Digital Library

Optics Letters

Optics Letters


  • Editor: Xi-Cheng Zhang
  • Vol. 39, Iss. 4 — Feb. 15, 2014
  • pp: 937–940

Content-adaptive high-resolution hyperspectral video acquisition with a hybrid camera system

Chenguang Ma, Xun Cao, Rihui Wu, and Qionghai Dai  »View Author Affiliations

Optics Letters, Vol. 39, Issue 4, pp. 937-940 (2014)

View Full Text Article

Enhanced HTML    Acrobat PDF (874 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools



We present a hybrid camera system that combines optical designs with computational processing to achieve content-adaptive high-resolution hyperspectral video acquisition. In particular, we record two video streams: one high-spatial resolution RGB video and one low-spatial resolution hyperspectral video in which the recorded points are dynamically selected using a spatial light modulator (SLM). Then through video-frame registration and a spatio-temporal spreading of the co-located spectral/RGB information, video with high spatial and spectral resolution is produced. The sampling patterns on the SLM are generated on-the-fly according to the scene content, which fully exploits the self-adaptivity of the hybrid camera system. With an experimental prototype, we demonstrate significantly improved accuracy and efficiency as compared to the state-of-the-art.

© 2014 Optical Society of America

OCIS Codes
(120.6200) Instrumentation, measurement, and metrology : Spectrometers and spectroscopic instrumentation
(110.1758) Imaging systems : Computational imaging

ToC Category:
Instrumentation, Measurement, and Metrology

Original Manuscript: September 25, 2013
Revised Manuscript: December 6, 2013
Manuscript Accepted: December 6, 2013
Published: February 10, 2014

Chenguang Ma, Xun Cao, Rihui Wu, and Qionghai Dai, "Content-adaptive high-resolution hyperspectral video acquisition with a hybrid camera system," Opt. Lett. 39, 937-940 (2014)

Sort:  Author  |  Year  |  Journal  |  Reset  


  1. W. M. Porter and H. T. Enmark, Proc. SPIE 834, 22 (1985).
  2. R. W. Basedow, D. C. Carmer, and M. E. Anderson, Proc. SPIE 2480, 258 (1995). [CrossRef]
  3. N. Gat, Proc. SPIE 4056, 50 (2000).
  4. M. Yamaguchi, H. Haneishi, H. Fukuda, J. Kishimoto, H. Kanazawa, M. Tsuchida, R. Iwama, and N. Ohyama, Proc. SPIE, 6062, 60620G (2006). [CrossRef]
  5. W. R. Johnson, D. W. Wilson, and G. Bearman, Appl. Opt. 45, 1898 (2006). [CrossRef]
  6. N. A. Hagen and E. L. Dereniak, Appl. Opt. 47, F85 (2008). [CrossRef]
  7. W. R. Johnson, D. W. Wilson, and G. Bearman, Opt. Lett. 30, 1464 (2005). [CrossRef]
  8. R. Habel, M. Kudenov, and M. Wimmer, Comput. Graph. Forum 31, 449 (2012). [CrossRef]
  9. M. E. Gehm, R. John, R. Willett, T. Schultz, and D. Brady, Opt. Express 15, 14013 (2007). [CrossRef]
  10. A. Wagadarikar, R. John, R. Willett, and D. Brady, Appl. Opt. 47, B44 (2008). [CrossRef]
  11. A. Wagadarikar, N. Pitsianis, X. Sun, and D. Brady, Opt. Express 17, 6368 (2009). [CrossRef]
  12. D. Kittle, D. Marks, and D. Brady, Opt. Eng. 51, 071403 (2012). [CrossRef]
  13. A. Bodkin, A. Sheinis, A. Norton, J. Daly, S. Beaven, and J. Weinheimer, Proc. SPIE 7334, 73340H (2009). [CrossRef]
  14. X. Cao, H. Du, X. Tong, Q. Dai, and S. Lin, IEEE Trans. Pattern Anal. Mach. Intell. 33, 2423 (2011).
  15. X. Cao, X. Tong, Q. Dai, and S. Lin, “High resolution multispectral video capture with a hybrid camera system,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI (2011), pp. 297–304.
  16. University of Joensuu Color Group, http://www.uef.fi/fi/spectral/spectral-image-database (2005).
  17. C. Nvidia, Compute Unified Device Architecture Programming Guide (NVIDIA Corp., 2007).

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Supplementary Material

» Media 1: MOV (4073 KB)     
» Media 2: MOV (2495 KB)     

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited