OSA's Digital Library

Applied Optics

Applied Optics

APPLICATIONS-CENTERED RESEARCH IN OPTICS

  • Editor: Joseph N. Mait
  • Vol. 53, Iss. 13 — May. 1, 2014
  • pp: C14–C24

Combining transverse field detectors and color filter arrays to improve multispectral imaging systems

Miguel A. Martínez, Eva M. Valero, Javier Hernández-Andrés, Javier Romero, and Giacomo Langfelder  »View Author Affiliations


Applied Optics, Vol. 53, Issue 13, pp. C14-C24 (2014)
http://dx.doi.org/10.1364/AO.53.000C14


View Full Text Article

Enhanced HTML    Acrobat PDF (669 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

This work focuses on the improvement of a multispectral imaging sensor based on transverse field detectors (TFDs). We aimed to achieve a higher color and spectral accuracy in the estimation of spectral reflectances from sensor responses. Such an improvement was done by combining these recently developed silicon-based sensors with color filter arrays (CFAs). Consequently, we sacrificed the filter-less full spatial resolution property of TFDs to narrow down the spectrally broad sensitivities of these sensors. We designed and performed several experiments to test the influence of different design features on the estimation quality (type of sensor, tunability, interleaved polarization, use of CFAs, type of CFAs, number of shots), some of which are exclusive to TFDs. We compared systems that use a TFD with systems that use normal monochrome sensors, both combined with multispectral CFAs as well as common RGB filters present in commercial digital color cameras. Results showed that a system that combines TFDs and CFAs performs better than systems with the same type of multispectral CFA and other sensors, or even the same TFDs combined with different kinds of filters used in common imaging systems. We propose CFA+TFD-based systems with one or two shots, depending on the possibility of using longer capturing times or not. Improved TFD systems thus emerge as an interesting possibility for multispectral acquisition, which overcomes the limited accuracy found in previous studies.

© 2014 Optical Society of America

OCIS Codes
(110.0110) Imaging systems : Imaging systems
(330.1690) Vision, color, and visual optics : Color
(330.1730) Vision, color, and visual optics : Colorimetry
(110.4234) Imaging systems : Multispectral and hyperspectral imaging

History
Original Manuscript: December 3, 2013
Revised Manuscript: March 19, 2014
Manuscript Accepted: March 19, 2014
Published: April 16, 2014

Virtual Issues
Vol. 9, Iss. 7 Virtual Journal for Biomedical Optics

Citation
Miguel A. Martínez, Eva M. Valero, Javier Hernández-Andrés, Javier Romero, and Giacomo Langfelder, "Combining transverse field detectors and color filter arrays to improve multispectral imaging systems," Appl. Opt. 53, C14-C24 (2014)
http://www.opticsinfobase.org/ao/abstract.cfm?URI=ao-53-13-C14


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. C. I. Chang, Hyperspectral Data Exploitation: Theory and Applications (Wiley, 2007).
  2. H. Grahn and P. Geladi, Techniques and Applications of Hyperspectral Image Analysis (Wiley, 2007).
  3. Y. Garini, I. T. Young, and G. McNamara, “Spectral imaging: principles and applications,” Cytometry 69, 735–747 (2006). [CrossRef]
  4. H. R. Morris, C. C. Hoyt, and P. J. Treado, “Imaging spectrometers for fluorescence and Raman microscopy: acousto-optic and liquid-crystal tunable filters,” Appl. Spectrosc. 48, 857–866 (1994). [CrossRef]
  5. S. E. Harris and R. W. Wallace, “Acousto-optic tunable filter,” J. Opt. Soc. Am. 59, 744–747 (1969). [CrossRef]
  6. I. Chang, “Acousto-optic tunable filters,” Opt. Eng. 20, 206824 (1981). [CrossRef]
  7. J. Y. Hardeberg, F. Schmitt, and H. Brettel, “Multispectral color image capture using a liquid-crystal tunable filter,” Opt. Eng. 41, 2532–2548 (2002). [CrossRef]
  8. A. Rodríguez, J. L. Nieves, E. Valero, E. Garrote, J. Hernández-Andrés, and J. Romero, “Modified fuzzy c-means applied to a Bragg-grating-based spectral imager for material clustering,” in IS&T/SPIE Electronic Imaging (International Society for Optics and Photonics, 2012), p. 83000J.
  9. N. Hagen and M. W. Kudenov, “Review of snapshot spectral imaging technologies,” Opt. Eng. 52, 090901 (2013). [CrossRef]
  10. L. Gao, R. T. Kester, N. Hagen, and T. S. Tkaczyk, “Snapshot image mapping spectrometer (IMS) with high sampling density for hyperspectral microscopy,” Opt. Express 18, 14330–14344 (2010). [CrossRef]
  11. J. Y. Hardeberg, Acquisition and Reproduction of Color Images: Colorimetric and Multispectral Approaches (Universal-Publishers, 2001).
  12. J. Brauers, N. Schulte, and T. Aach, “Multispectral filter-wheel cameras: geometric distortion model and compensation algorithms,” IEEE Trans. Image Process. 17, 2368–2380 (2008).
  13. R. Shrestha, J. Y. Hardeberg, and A. Mansouri, “One-shot multispectral color imaging with a stereo camera,” Proc. SPIE 7876, 787609 (2011).
  14. M. Tsuchida, T. Takahashi, K. Ito, T. Kawanishi, J. Yamato, and T. Aoki, “A stereo one-shot multi-band camera system for accurate color reproduction,” in ACM SIGGRAPH 2010 Posters (ACM, 2010), p. 66.
  15. M. Tsuchida, T. Kawanishi, K. Kashino, and J. Yamato, “A stereo nine-band camera for accurate color and spectrum reproduction,” in ACM SIGGRAPH 2012 Posters (ACM, 2012), p. 18.
  16. B. Gunturk, J. Glotzbach, Y. Altunbasak, R. Schafer, and R. Mersereau, “Demosaicking: color filter array interpolation,” IEEE Signal Process. Mag. 22, 44–54 (2005).
  17. Y. Murakami, M. Yamaguchi, and N. Ohyama, “Hybrid-resolution multispectral imaging using color filter array,” Opt. Express 20, 7173–7183 (2012). [CrossRef]
  18. Y. Murakami, A. Tanji, and M. Yamaguchi, “Development of a low-resolution spectral imager and its application to hybrid-resolution spectral imaging,” in Proceedings 12th International AIC Congress (2013), pp. 363–366.
  19. G. Langfelder, “Spectrally reconfigurable pixels for dual-color-mode imaging sensors,” Appl. Opt. 51, A91–A98 (2012). [CrossRef]
  20. A. Longoni, F. Zaraga, G. Langfelder, and L. Bombelli, “The transverse field detector (TFD): a novel color-sensitive CMOS device,” IEEE Electron. Device Lett. 29, 1306–1308 (2008).
  21. G. Langfelder, A. Longoni, and F. Zaraga, “Implementation of a multi-spectral color imaging device without color filter array,” Proc. SPIE 7876, 787607 (2011).
  22. M. Martínez-Domingo, E. Valero, J. Hernández-Andrés, and G. Langfelder, “Spectral reflectance estimation from transverse field detectors responses,” in Conference on Color in Graphics, Imaging, and Vision (Society for Imaging Science and Technology), 2012, pp. 378–383.
  23. G. D. Finlayson, J. Vazquez-Corral, S. Süsstrunk, and M. Vanrell, “Spectral sharpening by spherical sampling,” J. Opt. Soc. Am. A 29, 1199–1210 (2012). [CrossRef]
  24. E. R. Fossum, “CMOS image sensors: electronic camera-on-a-chip,” IEEE Trans. Electron Dev. 44, 1689–1698 (1997).
  25. P. M. Hubel, “Foveon technology and the changing landscape of digital cameras,” in Color and Imaging Conference (Society for Imaging Science and Technology, 2005), pp. 314–317.
  26. M. S. Drew and G. D. Finlayson, “Spectral sharpening with positivity,” J. Opt. Soc. Am. A 17, 1361–1370 (2000). [CrossRef]
  27. A. Lin and F. Imai, “Efficient spectral imaging based on imaging systems with scene adaptation using tunable color pixels,” in Color and Imaging Conference (Society for Imaging Science and Technology, 2011), pp. 332–338.
  28. F. H. Imai, “Computational spectral imaging based on adaptive spectral imaging,” in Computational Color Imaging (Springer, 2013), pp. 35–52.
  29. K. Hirakawa and P. J. Wolfe, “Spatio-spectral color filter array design for optimal image recovery,” IEEE Trans. Image Process. 17, 1876–1890 (2008).
  30. L. Miao, H. Qi, R. Ramanath, and W. Snyder, “Binary tree-based generic demosaicking algorithms for multispectral filter arrays,” IEEE T. Image Process. 15, 3550–3558 (2006).
  31. J. Brauers and T. Aach, “A color filter array-based multispectral camera,” in Workshop Farbbildverarbeitung (Ilmenau, 2006).
  32. G. Langfelder, T. Malzbender, A. Longoni, and F. Zaraga, “A device and an algorithm for the separation of visible and near infrared signals in a monolithic silicon sensor,” Proc. SPIE 7882, 788207 (2011).
  33. G. Langfelder, “CMOS pixels directly sensitive to both visible and near-infrared radiation,” IEEE Trans. Electron Dev. 60, 1695–1700 (2013).
  34. M. Hashimoto and J. Kishimoto, “Two-shot type 6-band still image capturing system using commercial digital camera and custom color filter,” in Conference on Color in Graphics, Imaging, and Vision (Society for Imaging Science and Technology, 2008), pp. 538–541.
  35. M. Tsuchida, A. Takayanagi, Y. Sakaguchi, and R. Mukai, “Estimation of spectral reflectance from six-band images based on partial least-squares regression,” in Proceedings 12th International AIC Congress, 2013, pp. 1785–1788.
  36. I. Chatzis, V. Kappatos, and E. Dermatas, “Filter selection for multi-spectral image acquisition using the feature vector analysis methods,” in Intelligent Production Machines and Systems: 2nd I* PROMS Virtual Conference (Elsevier Science, 2007).
  37. Y. Lu, I. Cohen, X. Zhou, and Q. Tian, “Feature selection using principal feature analysis,” in Proceedings of the 15th International Conference on Multimedia (ACM, 2007), pp. 301–304.
  38. Natural Color System (NCS). Scandinavian Colour Institute of Stockholm, Sweden, (1979).
  39. A. Hård and L. Sivik, “NCS- natural color system: a Swedish standard for color notation,” Color Res. Appl. 6, 129–138 (1981). [CrossRef]
  40. G. Langfelder, F. Zaraga, and A. Longoni, “Tunable spectral responses in a color-sensitive CMOS pixel for imaging applications,” IEEE Trans. Electron Dev. 56, 2563–2569 (2009).
  41. http://www.andovercorp.com/Web_store/Standard_BP/Std_BP_General.php .
  42. J. A. Hartigan and M. A. Wong, “Algorithm as 136: a k-means clustering algorithm,” J. Roy. Stat. Soc. C-App 28, 100–108 (1979).
  43. J. Hernández-Andrés, J. Romero, and R. L. Lee, “Colorimetric and spectroradiometric characteristics of narrow-field-of-view clear skylight in Granada, Spain,” J. Opt. Soc. Am. A 18, 412–420 (2001). [CrossRef]
  44. V. Heikkinen, A. Mirhashemi, and J. Alho, “Link functions and Matérn kernel in the estimation of reflectance spectra from RGB responses,” J. Opt. Soc. Am. A 30, 2444–2454 (2013). [CrossRef]
  45. F. H. Imai, M. R. Rosen, and R. S. Berns, “Comparative study of metrics for spectral match quality,” in Conference on Colour in Graphics, Image and Vision (Society for Imaging Science and Technology, 2002), pp. 492–496.
  46. G. Sharma, W. Wu, and E. Dalal, “The CIEDE2000 color-difference formula: implementation notes, supplementary test data, and mathematical observations,” Color Res. Appl. 30, 21–30 (2005). [CrossRef]
  47. J. L. Nieves, E. M. Valero, S. M. Nascimento, J. Hernández-Andrés, and J. Romero, “Multispectral synthesis of daylight using a commercial digital CCD camera,” Appl. Opt. 44, 5696–5703 (2005). [CrossRef]
  48. V. Heikkinen, T. Jetsu, J. Parkkinen, M. Hauta-Kasari, T. Jaaskelainen, and S. Lee, “Regularized learning framework in the estimation of reflectance spectra from camera responses,” J. Opt. Soc. Am. A 24, 2673–2683 (2007). [CrossRef]
  49. V. Heikkinen, “Kernel methods for estimation and classification of data from spectral imaging,” Ph.D. dissertation (Faculty of Forestry and Natural Sciences, University of Eastern Finland, 2011).
  50. M. Martínez-Domingo, E. Valero, V. Heikkinen, and G. Langfelder, “Design of a multispectral system based on transverse field detectors,” in Proceedings 12th International AIC Congress, 2013, pp. 371–374.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Figures

Fig. 1. Fig. 2. Fig. 3.
 

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited