We present a hybrid camera system that combines optical designs with computational processing to achieve content-adaptive high-resolution hyperspectral video acquisition. In particular, we record two video streams: one high-spatial resolution RGB video and one low-spatial resolution hyperspectral video in which the recorded points are dynamically selected using a spatial light modulator (SLM). Then through video-frame registration and a spatio-temporal spreading of the co-located spectral/RGB information, video with high spatial and spectral resolution is produced. The sampling patterns on the SLM are generated on-the-fly according to the scene content, which fully exploits the self-adaptivity of the hybrid camera system. With an experimental prototype, we demonstrate significantly improved accuracy and efficiency as compared to the state-of-the-art.
© 2014 Optical Society of America
Instrumentation, Measurement, and Metrology
Original Manuscript: September 25, 2013
Revised Manuscript: December 6, 2013
Manuscript Accepted: December 6, 2013
Published: February 10, 2014
Chenguang Ma, Xun Cao, Rihui Wu, and Qionghai Dai, "Content-adaptive high-resolution hyperspectral video acquisition with a hybrid camera system," Opt. Lett. 39, 937-940 (2014)