OSA's Digital Library

Optics Express

Optics Express

  • Editor: Andrew M. Weiner
  • Vol. 22, Iss. 2 — Jan. 27, 2014
  • pp: 1697–1712

Bispectral coding: compressive and high-quality acquisition of fluorescence and reflectance

Jinli Suo, Liheng Bian, Feng Chen, and Qionghai Dai  »View Author Affiliations


Optics Express, Vol. 22, Issue 2, pp. 1697-1712 (2014)
http://dx.doi.org/10.1364/OE.22.001697


View Full Text Article

Enhanced HTML    Acrobat PDF (1258 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Fluorescence widely coexists with reflectance in the real world, and an accurate representation of these two components in a scene is vitally important. Despite the rich knowledge of fluorescence mechanisms and behaviors, traditional fluorescence imaging approaches are quite limited in efficiency and quality. To address these two shortcomings, we propose a bispectral coding scheme to capture fluorescence and reflectance: multiplexing code is applied to excitation spectrums to raise the signal-to-noise ratio, and compressive sampling code is applied to emission spectrums for high efficiency. For computational reconstruction from the sparse coded measurements, the redundancy in both components promises recovery from sparse measurements, and the difference between their redundancies promises accurate separation. Mathematically, we cast the reconstruction as a joint optimization, whose solution can be derived by the Augmented Lagrange Method. In our experiment, results on both synthetic data and real data captured by our prototype validate the proposed approach, and we also demonstrate its advantages in two computer vision tasks—photorealistic relighting and segmentation.

© 2014 Optical Society of America

OCIS Codes
(300.6280) Spectroscopy : Spectroscopy, fluorescence and luminescence
(110.1758) Imaging systems : Computational imaging
(110.4234) Imaging systems : Multispectral and hyperspectral imaging

ToC Category:
Imaging Systems

History
Original Manuscript: September 12, 2013
Revised Manuscript: December 19, 2013
Manuscript Accepted: January 5, 2014
Published: January 17, 2014

Virtual Issues
Vol. 9, Iss. 3 Virtual Journal for Biomedical Optics

Citation
Jinli Suo, Liheng Bian, Feng Chen, and Qionghai Dai, "Bispectral coding: compressive and high-quality acquisition of fluorescence and reflectance," Opt. Express 22, 1697-1712 (2014)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-22-2-1697


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. R. Donaldson, “Spectrophotometry of fluorescent pigments,” Br. J. Appl. Phys.5(6), 210–214 (1954). [CrossRef]
  2. I. Sato and C. Zhang, “Image-based separation of reflective and fluorescent components using illumination variant and invariant color,” IEEE Trans. Pattern Anal.35(12), 2866–2877 (2013). [CrossRef]
  3. A. D. McNaught and A. Wilkinson, Compendium of Chemical Terminology (Blackwell Science, 1997).
  4. A. Springsteen, “Introduction to measurement of color of fluorescent materials,” Anal. Chim. Acta380(2), 183–192 (1999). [CrossRef]
  5. G. M. Johnson and M. D. Fairchild, “Full-spectral color calculations in realistic image synthesis,” IEEE Comput. Graphics Appl.19(4), 47–53 (1999). [CrossRef]
  6. M. B. Hullin, J. Hanika, B. Ajdin, H.-P. Seidel, J. Kautz, and H. P. A. Lensch, “Acquisition and analysis of bis-pectral bidirectional reflectance and reradiation distribution functions,” ACM Trans. Graphics29(4), 1–7 (2010). [CrossRef]
  7. M. Soriano, W. Oblefias, and C. Saloma, “Fluorescence spectrum estimation using multiple color images and minimum negativity constraint,” Opt. Express10(25), 1458–1464 (2002). [CrossRef] [PubMed]
  8. Q. Liu, K. Chen, M. Martin, A. Wintenberg, R. Lenarduzzi, M. Panjehpour, B. F. Overholt, and T. Vo-Dinh, “Development of a synchronous fluorescence imaging system and data analysis methods,” Opt. Express15(20), 12583–12594 (2007). [CrossRef] [PubMed]
  9. T. Vo-Dinh, “Principle of synchronous luminescence (SL) technique for biomedical diagnostics,” Proc. SPIE3911, 42–49 (2000). [CrossRef]
  10. I. Sato, T. Okabe, and Y. Sato, “Bispectral photometric stereo based on fluorescence,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2012), pp. 270–277.
  11. S. Han, Y. Matsushita, I. Sato, T. Okabe, and Y. Sato, “Camera spectral sensitivity estimation from a single image under unknown illumination by using fluorescence,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2012), pp. 805–812.
  12. C. Chi, H. Yoo, and M. Ben-Ezra, “Multi-spectral imaging by optimized wide band illumination,” Int. J. Comput. Vision86(2–3), 140–151 (2010). [CrossRef]
  13. M. Alterman, Y. Schechner, and A. Weiss, “Multiplexed fluorescence unmixing,” in Proceedings of IEEE International Conference on Computational Photography (IEEE, 2010), pp. 1–8.
  14. J. Park, M. Lee, M. D. Grossberg, and S. K. Nayar, “Multispectral imaging using multiplexed illumination,” in Proceedings of IEEE Conference on Computer Vision (IEEE, 2007), pp. 1–8.
  15. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Separating the fluorescence and reflectance components of coral spectra,” Appl. Opt.40(21), 3614–3621 (2001). [CrossRef]
  16. M. E. Gehm, R. John, D. J. Brady, R. M. Willett, and T. J. Schulz, “Single-shot compressive spectral imaging with a dual disperser architecture,” Opt. Express15(21), 14013–14027 (2007). [CrossRef] [PubMed]
  17. A. Wagadarikar, R. John, R. Willett, and D. Brady, “Single disperser design for coded aperture snapshot spectral imaging,” Appl. Opt.47(10), B44–B51 (2008). [CrossRef] [PubMed]
  18. R. Horisaki, X. Xiao, J. Tanida, and B. Javidi, “Feasibility study for compressive multi-dimensional integral imaging,” Opt. Express21(4), 4263–4279 (2013). [CrossRef] [PubMed]
  19. R. Horisaki and J. Tanida, “Multi-channel data acquisition using multiplexed imaging with spatial encoding,” Opt. Express18(22), 23041–23053 (2010). [CrossRef] [PubMed]
  20. Y. Wu, I. O. Mirza, G. R. Arce, and D. W. Prather, “Development of a digital-micromirror-device-based multishot snapshot spectral imaging system,” Opt. Lett.36(14), 2692–2694 (2011). [CrossRef] [PubMed]
  21. Y. August and A. Stern, “Compressive sensing spectrometry based on liquid crystal devices,” Opt. Lett.38(23), 4996–4999 (2013). [CrossRef] [PubMed]
  22. G. Wetzstein, I. Ihrke, and W. Heidrich, “On plenoptic multiplexing and reconstruction,” Int. J. Comput. Vision101(2), 384–400 (2013). [CrossRef]
  23. N. Ratner and Y. Y. Schechner, “Illumination multiplexing within fundamental limits,” in Proceedings of IEEE Conference on Computer Vision (IEEE, 2011), pp. 1–8.
  24. Y. Y. Schechner, S. K. Nayar, and P. N. Belhumeur, “Multiplexing for optimal lighting,” IEEE Pattern Anal. Mach. Intell.29(8), 1339–1354 (2007). [CrossRef]
  25. C. Chen, D. Vaquero, and M. Turk, “Illumination demultiplexing from a single image,” in Proceedings of IEEE Conference on Computer Vision (IEEE, 2011), pp. 17–24.
  26. F. Moreno-Noguer, S. Nayar, and P. Belhumeur, “Optimal illumination for image and video relighting,” in Proceedings of IEE European Conference on Visual Media Production (IEE, 2005), pp. 201–210.
  27. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Found. Trends Mach. Learning3(1), 741–755 (2010). [CrossRef]
  28. A. Yang, S. Sastry, A. Ganesh, and Y. Ma, “Fast-minimization algorithms and an application in robust face recognition: A review,” in Proceedings of IEEE Conference on Image Processing (IEEE, 2010), pp. 1849–1852.
  29. Y. Deng, Q. Dai, and Z. Zhang, “An overview of computational sparse models and their applications in artificial intelligence,” Artif. Intell. Evol. Comput. Metaheuristics427, 345–369 (2012). [CrossRef]
  30. Z. Lin, M. Chen, L. Wu, and Y. Ma, “The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices,” in Technical Report UILU-ENG-09-2215 (UIUC, 2009).
  31. M. Harwit and N. J. A. Sloane, Hadamard Transform Optics (Academic, 1979).
  32. A. Lam and I. Sato, “Spectral modeling and relighting of reflective-fluorescent scenes,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2013), pp. 1452–1459.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited