OSA's Digital Library

Biomedical Optics Express

Biomedical Optics Express

  • Editor: Joseph A. Izatt
  • Vol. 5, Iss. 6 — Jun. 1, 2014
  • pp: 1757–1767
« Show journal navigation

Spectral multiplexing and coherent-state decomposition in Fourier ptychographic imaging

Siyuan Dong, Radhika Shiradkar, Pariksheet Nanda, and Guoan Zheng  »View Author Affiliations


Biomedical Optics Express, Vol. 5, Issue 6, pp. 1757-1767 (2014)
http://dx.doi.org/10.1364/BOE.5.001757


View Full Text Article

Acrobat PDF (4032 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

Information multiplexing is important for biomedical imaging and chemical sensing. In this paper, we report a microscopy imaging technique, termed state-multiplexed Fourier ptychography (FP), for information multiplexing and coherent-state decomposition. Similar to a typical Fourier ptychographic setting, we use an array of light sources to illuminate the sample from different incident angles and acquire corresponding low-resolution images using a monochromatic camera. In the reported technique, however, multiple light sources are lit up simultaneously for information multiplexing, and the acquired images thus represent incoherent summations of the sample transmission profiles corresponding to different coherent states. We show that, by using the state-multiplexed FP recovery routine, we can decompose the incoherent mixture of the FP acquisitions to recover a high-resolution sample image. We also show that, color-multiplexed imaging can be performed by simultaneously turning on R/G/B LEDs for data acquisition. The reported technique may provide a solution for handling the partially coherent effect of light sources used in Fourier ptychographic imaging platforms. It can also be used to replace spectral filter, gratings or other optical components for spectral multiplexing and demultiplexing. With the availability of cost-effective broadband LEDs, the reported technique may open up exciting opportunities for computational multispectral imaging.

© 2014 Optical Society of America

1. Introduction

Fourier ptychography (FP) [1

1. G. Zheng, R. Horstmeyer, and C. Yang, “Wide-field, high-resolution Fourier ptychographic microscopy,” Nat. Photonics 7(9), 739–745 (2013). [CrossRef]

] is a recently developed microscopy imaging approach that applies angular diversity functions for high-resolution complex image recovery. Sharing its root with synthetic aperture technique [2

2. M. Ryle and A. Hewish, “The synthesis of large radio telescopes,” Mon. Not. R. Astron. Soc. 120, 220 (1960).

, 3

3. A. B. Meinel, “Aperture synthesis using independent telescopes,” Appl. Opt. 9(11), 2501 (1970). [CrossRef] [PubMed]

], FP synthesizes many variably illuminated, low-resolution intensity images in the Fourier space to expand the passband and surpass the diffraction limit of the objective lens. The recovery process of FP switches between spatial and Fourier domains. In the spatial domain, the amplitudes of the acquired images are used to constraint the FP solution, similar to the strategy of phase retrieval techniques [4

4. R. Gerchberg, “A practical algorithm for the determination of phase from image and diffraction plane pictures,” Optik (Stuttg.) 35, 237 (1972).

14

14. C.-H. Lu, C. Barsi, M. O. Williams, J. N. Kutz, and J. W. Fleischer, “Phase retrieval using nonlinear diversity,” Appl. Opt. 52(10), D92–D96 (2013). [CrossRef] [PubMed]

]. In the Fourier domain, the panning Fourier constraints are imposed to reflect the angle-varied illuminations. The name ‘Fourier ptychography’ comes from ptychography [15

15. H. M. L. Faulkner and J. M. Rodenburg, “Movable Aperture Lensless Transmission Microscopy: A Novel Phase Retrieval Algorithm,” Phys. Rev. Lett. 93(2), 023903 (2004). [CrossRef] [PubMed]

27

27. J. M. Rodenburg and R. H. T. Bates, “The Theory of Super-Resolution Electron Microscopy Via Wigner-Distribution Deconvolution,” Philosoph. Trans. R. Soc. London. Ser. A: Phys. Eng. Sci. 339(1655), 521–553 (1992). [CrossRef]

], a lensless imaging technique originally proposed for transmission electron microscopy [26

26. W. Hoppe and G. Strube, “Diffraction in inhomogeneous primary wave fields. 2. Optical experiments for phase determination of lattice interferences,” Acta Crystallogr. A 25, 502–507 (1969). [CrossRef]

]. Both FP and lensless ptychography adopt phase diversity concept [8

8. R. A. Gonsalves, “Phase retrieval and diversity in adaptive optics,” Opt. Eng. 21, 215829 (1982).

, 11

11. B. H. Dean and C. W. Bowers, “Diversity selection for phase-diverse phase retrieval,” J. Opt. Soc. Am. A 20(8), 1490–1504 (2003). [CrossRef] [PubMed]

] for image recovery. Lensless ptychography applies translational diversity (laterally moving the sample) [16

16. M. Guizar-Sicairos and J. R. Fienup, “Phase retrieval with transverse translation diversity: a nonlinear optimization approach,” Opt. Express 16(10), 7264–7278 (2008). [CrossRef] [PubMed]

] for inverting the diffraction process and recovering the complex image without using lens elements. Fourier ptychography, on the other hand, introduces the ‘angular diversity’ concept to simultaneously expand the Fourier passband and recover the ‘lost’ phase information [28

28. X. Ou, R. Horstmeyer, C. Yang, and G. Zheng, “Quantitative phase imaging via Fourier ptychographic microscopy,” Opt. Lett. 38(22), 4845–4848 (2013). [CrossRef] [PubMed]

]. The use of lens elements in FP settings also provides a higher signal-to-noise ratio and reduces the coherence requirement of the light source. It has been shown that, without involving any interferometric measurement or mechanical scanning, FP surpasses the diffraction limit defined by the numerical aperture (NA) of the objective lens [1

1. G. Zheng, R. Horstmeyer, and C. Yang, “Wide-field, high-resolution Fourier ptychographic microscopy,” Nat. Photonics 7(9), 739–745 (2013). [CrossRef]

].

Despite the successful demonstration of the FP approach, its operation is currently limited to the single coherent state of the light source. In other words, the light source in FP settings is assumed to be spatially a point source and temporally a single wavelength. Incoherent mixture of multiple coherent states has not been considered in the FP recovery procedures. Therefore, one important step for advancing the FP technique is to develop a recovery scheme for handling state mixture and performing information multiplexing with FP acquisitions. As we will discuss later, such a state-multiplexed FP scheme may find applications in coherent-state decomposition and computational multispectral imaging.

This paper is structured as follows: in Section 2, we describe the recovery procedures of the state-multiplexed FP scheme. In Section 3, we demonstrate the effectiveness of the reported scheme with both simulations and experiments. In Section 4, we demonstrate the use of the reported scheme for color-multiplexed FP imaging. Finally, we summarize the results and discuss future directions.

2. State-multiplexed Fourier ptychography

To understand the operation of the state-multiplexed FP scheme, it is worthwhile to review the basic concepts of single-state FP approach. As detailed in [1

1. G. Zheng, R. Horstmeyer, and C. Yang, “Wide-field, high-resolution Fourier ptychographic microscopy,” Nat. Photonics 7(9), 739–745 (2013). [CrossRef]

, 28

28. X. Ou, R. Horstmeyer, C. Yang, and G. Zheng, “Quantitative phase imaging via Fourier ptychographic microscopy,” Opt. Lett. 38(22), 4845–4848 (2013). [CrossRef] [PubMed]

, 34

34. G. Zheng, “Breakthroughs in Photonics 2013: Fourier Ptychographic Imaging,” IEEE Photon. J. 6(2), 1–7 (2014). [CrossRef]

], a typical FP platform consists of an LED array, a conventional microscope with a low-NA objective lens, and a monochromatic CCD camera. The LED elements on the array are turned on sequentially to illuminate the sample from different incident angles. At each illumination angle, the camera acquires a low-resolution intensity image of the sample. These acquired images are then stitched with overlap in the Fourier domain using the single-state FP algorithm.

The single-state algorithm starts with a high-resolution estimate of the sample profile (can be a random guess): Iheiφh. This sample estimate is then low-pass filtered to produce a low-resolution target image Iteiφt, simulating the filtering process of the objective lens. Next, the intensity component of the target image It is replaced by the actual measurement Im, while the phase component is kept unchanged. The updated target image is then used to modify the corresponding spectrum region of the sample estimate. This replace-and-update sequence is repeated for all intensity measurements, and iterated several times until the solution converges.

In such a single-state FP algorithm, the generated low-resolution target images uniquely map to different regions of the sample estimate in the Fourier space. This one-to-one mapping relationship is a direct consequence of the single-coherent-state assumption, i.e., the illumination is assumed to be a point source spatially and a single wavelength temporally. In the case of low-coherent Fourier ptychographic acquisition, the intensity measurement represents an incoherent summation of different coherent states [32

32. P. Thibault and A. Menzel, “Reconstructing state mixtures from diffraction measurements,” Nature 494(7435), 68–71 (2013). [CrossRef] [PubMed]

], and thus, the mapping between the low-resolution target image and the high-resolution sample estimate is not in a one-to-one relationship. In the reported state-multiplexed FP scheme, we model the decoherent effect using multiple target images, corresponding to different coherent states of the light source [32

32. P. Thibault and A. Menzel, “Reconstructing state mixtures from diffraction measurements,” Nature 494(7435), 68–71 (2013). [CrossRef] [PubMed]

].

The recovery process of the state-multiplexed FP scheme is shown in Fig. 1
Fig. 1 The recovery procedures of the state-multiplexed Fourier ptychography scheme.
. Similar to the single-state scheme, it starts with a high-resolution estimate of the sample profile: Iheiφh. This sample estimate is used to generate multiple low-resolution target images corresponding to different coherent states. Second, the intensity components of the target images are summed up to generate the incoherent mixture It. Third, the ratio between the actual measurement Im and It is used to update the intensity components of the target images, while the phase components are kept unchanged. Fourth, the updated target images are used to modify the corresponding spectral regions of the sample estimate. Lastly, the entire process is repeated for all intensity measurements, and iterated for several times until the solution converges. The computational cost of the state-multiplexed FP scheme is linearly proportional to the number of coherent states. For example, the computational time of two-state multiplexing is twice of the single-state’s computational time.

The key difference between the reported scheme and the single-state FP lies in the intensity replacement process. In the single-state FP, the intensity component of the target image is directly replaced by the actual measurement Im while the phase component is kept unchanged. The reported state-multiplexed scheme, on the other hand, uses the ratio between the incoherent mixture and the actual measurement to update the intensity components of the target images. This new updating process ensures that the intensity summation of different coherent modes equates to the measured incoherent mixture, while the phase of individual modes is preserved.

3. Simulations and experiments of the state-multiplexed FP scheme

We first validated the state-multiplexed scheme using simulations. The simulation parameters were chosen to realistically model a light microscope experiment, with an incident wavelength of 632 nm, a pixel size of 1.375 µm (at the sample plane) and an objective NA of 0.1 (Olympus 4X Plan). We simulated the use of a 15*15 LED (SMD 3528) array for illuminating the sample with different incident angles. The LED array is placed 85 mm beneath the sample, and the distance between adjacent LEDs is 4 mm.

The high-resolution input intensity and phase profiles are shown in Fig. 2
Fig. 2 Simulations of the single-state and state-multiplexed FP schemes. (a1) and (a2) The input intensity and phase images of the simulated object. (b1) Raw data of the single-state FP scheme. Each low-resolution image (0.1 NA) corresponds to one LED element in the array. (b2) and (b3) The recovered sample intensity and phase images using the single-state FP scheme. (c1) Raw data of the state-multiplexed FP scheme. Two adjacent LED elements are lit up simultaneously for sample illumination, and each low-resolution intensity image (0.1 NA) represents an incoherent summation of two coherent states. (c2) and (c3) The recovered sample intensity and phase images (0.5 NA) using the state-multiplexed FP scheme. (d1) and (d2) The reconstructions of state-mixed raw data using the single-state FP scheme (for comparison).
(a1) and (a2), which serve as the ground truth for the simulated complex object. We then simulated the low-resolution measurements for 1) the single-state FP scheme and 2) the state-multiplexed FP scheme. For the single-state scheme, each low-resolution intensity image corresponds to one LED element in the array (225 images), as shown in Fig. 2(b1). The corresponding reconstructed intensity and phase images are shown in Fig. 2(b2) and 2(b3). For the state-multiplexed scheme, we simulated the case of two adjacent LED elements lighting up simultaneously for sample illumination. In this case, each low-resolution intensity image (Fig. 2(c1)) represents an incoherent summation of two coherent states. As we group two LEDs as one light source element, the total number of simulated low-resolution images reduces by half (113 images; we did not group the last LED element). We note that, the spectrum-overlapping percentage (i.e., the data redundancy requirement) is determined by the distance between two adjacent light sources. In this case, two LEDs can be viewed as one ‘larger’ light source element, and the resulting averaged spectrum-overlapping percentage is determined to be ~55%, satisfying the convergence condition of ~40% [35

35. S. Dong, Z. Bian, R. Shiradkar, and G. Zheng, “Sparsely sampled Fourier ptychography,” Opt. Express 22(5), 5455–5464 (2014). [CrossRef] [PubMed]

]. Based on the simulated low-resolution state-mixtures, we applied the state-multiplexed FP scheme to recover the high-resolution sample images in Fig. 2(c2) and 2(c3). Using the state-mixture data set, we also used the single-state FP scheme (for comparison purpose) to reconstruct the sample images in Fig. 2(d1) and 2(d2).

The image qualities of different FP reconstructions are quantified using the mean-square errors (the difference between the FP reconstructions and the ground truth; smaller errors represent better reconstruction). The mean-square errors for Fig. 2(b2), 2(c2), and 2(d1) are 0.11%, 0.47% and 4.0%, respectively. From this set of simulations, we can see that, the reported state-multiplexed scheme is able to recover the sample image with quality similar to single-state FP.

From Fig. 3, we can see that, the state-multiplexed FP is able to recover high-resolution sample images from state-mixed measurements, and the quality of the reconstructions is comparable to that of single-state FP. This experiment validates the effectiveness of the reported state-multiplexed FP recover routine.

4. Spectrsl multiplexing in Fourier ptychographic imaging

One important application of the state-multiplexed FP scheme is multispectral imaging. Light sources with multiple wavelengths can be used to illuminate the sample from different incident angles, and the acquired images represent incoherent summations of the sample transmission profiles at different wavelengths. A state-multiplexed FP algorithm can then be used to reconstruct multiple high-resolution images at different wavelengths. In this section, we demonstrate such a state-multiplexed scheme for color multiplexing, which we will refer to as “color-multiplexed FP”. It is also important to acknowledge that, color multiplexing has recently been demonstrated for lensless ptychography by using the concept of translational diversity (laterally moving the sample over different spatial positions) [33

33. D. J. Batey, D. Claus, and J. M. Rodenburg, “Information multiplexing in ptychography,” Ultramicroscopy 138, 13–21 (2014). [CrossRef] [PubMed]

].

The operation principle of color-multiplexed FP is shown in Fig. 4
Fig. 4 Color-multiplexed FP scheme. R/G/B LEDs are turned on simultaneously for illumination. Low-resolution images are acquired using a 0.1 NA objective lens and a monochrome camera. A color-multiplexed FP recovery algorithm is then used to decouple the R/G/B channels from the low-resolution images. A high-resolution color image of the sample can be recovered using computation instead of spectral filters.
, where we used a color LED array for sample illumination and acquired low-resolution images using a monochromatic camera. Since R/G/B LED elements were turned on simultaneously in the acquisition process, the acquired images represent incoherent summations of sample profiles at R/G/B wavelengths. Such state-mixed raw data is then used to recover three high-resolution images at the corresponding wavelengths and produce a final color image of the sample.

The recovery process of the color-multiplexed FP scheme is similar to that of state-multiplexed scheme. However, in this case, multiple sample estimates at different wavelengths are used in the workflow. As shown in Fig. 5
Fig. 5 Color-multiplexed FP recovery routine.
, three sample estimates are used to generate the corresponding target images. The intensity components of the target images are summed up to generate the incoherent mixture It, and the target images are updated using the ratio between the actual measurement Im and It. The updated target images are then used to modify the corresponding spectral regions of the sample estimates. The entire process is repeated for all intensity measurements, and iterated for several times until the solution converges. Lastly, the recovered images at different wavelengths are combined to produce a high-resolution color image.

As before, we first validated the color-multiplexed FP using simulations. We simulated a 15*15 color LED array with red/green/blue (632 nm, 532 nm, and 472 nm) elements lighting up simultaneously; other parameters being the same. The high-resolution input images (the ground truth) at three different channels are shown in Fig. 6
Fig. 6 Simulations of the color-multiplexed FP scheme. (a) Input R/G/B channels and the color image. (b) The low-resolution intensity measurement of the object, representing an incoherent summation of 3 object profiles at different wavelengths. (c) The color-multiplexed FP recovery (0.5 NA). The mean-square errors for (c1)-(c3) are 0.5%, 0.4%, and 0.1%, respectively.
(a1)-6(a3), and the corresponding color image is shown in Fig. 6(a4). The simulated low-resolution measurement is shown in Fig. 6(b), which represents an incoherent summation of three coherent states of the sample profiles. We then applied the color-multiplexed FP recovery algorithm to perform reconstruction, and the results are shown in Fig. 6(c1)-6(c4). We also quantified the image quality by calculating the mean-square errors, and the results are 0.5%, 0.4%, and 0.1% for Fig. 6(c1)-6(c3) respectively. We can see that, the color-multiplexed FP scheme is able to recover the color image of the sample from state-mixed measurements.

We also validated the color-multiplexed FP scheme using a light microscope experiment, as shown in Fig. 7
Fig. 7 Experimental demonstration of the color-multiplexed FP scheme. (a) Raw data of the color-multiplexed FP acquisition, representing incoherent summation of the sample profiles at three wavelengths. (b1)-(b3) The recovered color-multiplexed high-resolution images (0.5 NA) at red, green, and blue channels. (c) The recovered color image by combining (b1)-(b3) (with white balance). (d) The recovered color image (0.5 NA) using three separated FP acquisitions with individual red, green, and blue illumination (no state-mixing). (e) Color image using a conventional microscope with a 40X high-NA objective lens (0.6 NA).
. We used a pathology slide (human breast cancer section, Carolina Inc.) as our sample, and R/G/B LEDs were turned on simultaneously for sample illumination. Low-resolution images were acquired using the 0.1 NA objective lens and the monochrome camera (parameters are the same as that for simulations). As such, these measurements represent incoherent mixtures of sample profiles at three wavelengths, as shown in Fig. 7(a). The color-multiplexed FP algorithm was then used to decouple into the R/G/B channels from the state-mixed measurements and recover the high-resolution color image of the sample. Figure 7(b1)-7(b3) demonstrate the recovered images for R/G/B channels, and the final color image is shown in Fig. 7(c). We also reconstruct the color image from three separated FP acquisitions (without state-mixing) in Fig. 7(d). As a comparison, the color image captured using a conventional 40X objective lens (0.6 NA) is shown in Fig. 7(e). However, we note that, the focal plane of Fig. 7(e) may slightly shift when we switch the objective lens (the sample is about 15 µm thick).

From this experiment, we can see that, the color-multiplexed FP algorithm is able to recover the high-resolution color image from the state-mixed measurements. We found that, the major noise source in our experiment was from the intensity uncertainty of the light source array. For example, the intensity fluctuations of R/G/B LED elements change the ratio of color components, creating state-decomposing errors and color mismatch problem for FP reconstructions. To address this problem, we can use a spectroscopic element to better calibrate the intensity values of the different LEDs in the array. Adaptive correction scheme can also be used to correct for intensity uncertainty in a post-processing manner [36

36. Z. Bian, S. Dong, and G. Zheng, “Adaptive system correction for robust Fourier ptychographic imaging,” Opt. Express 21(26), 32400–32410 (2013). [CrossRef] [PubMed]

]. We also found that, under the same illumination intensity, the intrinsic image contrast for the blue channel is weaker that of red and green channels. To address this problem, we can adjust the illumination intensity ratio between different wavelength components. The optimal intensity ratio may depend on the employed staining technique. Nevertheless, the experiment shown in Fig. 7 provides a proof-of-concept demonstration of the color-multiplexed FP scheme.

5. Discussion and conclusion

In summary, we have developed and tested a state-multiplexed recovery scheme for Fourier ptychographic imaging. In this scheme, we use multiple target images for handling different coherent states of the light source and then update the high-resolution sample image accordingly. We have demonstrated the applications of the reported scheme for coherent-state decomposition and color-multiplexed imaging.

The state-multiplexed scheme can be used to model the partially coherent effects of the employed light sources. For example, the finite extent of the light source (related to spatial coherence) can be modeled as multiple point sources emitting light independently. The finite spectrum of the light source (related to temporal coherence) can be modeled as multiple light sources emitting light with different, but narrower passbands. The finite spatial extent or the emission band of the LED can be separated into different point sources or narrower passbands until no difference between adjacent states can be detected. However, we note that, in our current implementation, the major reconstruction error comes from the intensity uncertainty of the LED array, not the partially coherent effects of the light source element. We also note that, instead of light up two components simultaneously, we can also light up more components in the array to form, for example, Hadamard basis patterns. By using the optimal basis, we may be able to reduce the number of acquisitions and raise the photon budget.

Furthermore, the spectrum-multiplexing scheme reported in this work can be used to replace thin-film interference filters, gratings or other optical components for spectral multiplexing and demultiplexing. We note that, the conventional ptychography approach typically requires the use of high-coherence light sources. The reported approach, on the other hand, considerably reduces the coherence requirement. In our demonstrations, we used a color LED array for imaging a pathology slide. It would be straight forward to extend the reported approach for more wavelengths using low-cost broadband LEDs.

Multispectral microscopy imaging is an emerging modality for various biomedical applications. This technology uses visible light as well as ultraviolet and infrared light to acquire more information from specimens. With the rich information of the 3D multispectral data cube, tissue constituents can be more easily identified with their spectral signatures [37

37. M. N. Gurcan, L. E. Boucheron, A. Can, A. Madabhushi, N. M. Rajpoot, and B. Yener, “Histopathological image analysis: A review,” IEEE Rev. Biomed. Eng. 2, 147–171 (2009). [CrossRef] [PubMed]

]. For example, multispectral microscopy has been demonstrated for differentiating prostate cancer [38

38. H. Akbari, L. V. Halig, D. M. Schuster, A. Osunkoya, V. Master, P. T. Nieh, G. Z. Chen, and B. Fei, “Hyperspectral imaging and quantitative analysis for prostate cancer detection,” J. Biomed. Opt. 17(7), 0760051 (2012). [CrossRef] [PubMed]

], cancerous colon biopsies [39

39. F. Woolfe, M. Maggioni, G. Davis, F. Warner, R. Coifman, and S. Zucker, “Hyper-spectral microscopic discrimination between normal and cancerous colon biopsies,” IEEE Trans. Med. Imaging 99, 9999 (1999).

], and melanoma [40

40. D. T. Dicker, J. Lerner, P. Van Belle, S. F. Barth, D. Guerry 4th, M. Herlyn, D. E. Elder, and W. S. El-Deiry, “Differentiation of Normal Skin and Melanoma using High Resolution Hyperspectral Imaging,” Cancer Biol. Ther. 5(8), 1033–1038 (2006). [CrossRef] [PubMed]

] using pathology slides. It has also found applications in chemical imaging and sensing using functioned nanoparticles [41

41. K. Hoshino, P. P. Joshi, G. Bhave, K. V. Sokolov, and X. Zhang, “Use of colloidal quantum dots as a digitally switched swept light source for gold nanoparticle based hyperspectral microscopy,” Biomed. Opt. Express 5(5), 1610–1615 (2014). [CrossRef]

]. Different from other multispectral imaging geometries, the reported FP scheme can be implemented with most existing microscopes in a cost-effective manner. The resolution and throughput are also adequate for microscopy screening. We anticipate that, the reported scheme can provide a practical solution for multispectral microscopy and open up exciting opportunities for computational multispectral imaging in the near future. Our on-going efforts include the development of a high-power white light LED array for sample illumination.

Finally, we note that, the effectiveness of the spectrum-multiplexed approach may depend on the data redundancy and the compressibility of the sample image [35

35. S. Dong, Z. Bian, R. Shiradkar, and G. Zheng, “Sparsely sampled Fourier ptychography,” Opt. Express 22(5), 5455–5464 (2014). [CrossRef] [PubMed]

]. This relationship can be directed to the recent development of compressive sensing [42

42. R. Baraniuk, “Compressive sensing,” IEEE Signal Process. Mag. 24(4), 118–121 (2007). [CrossRef]

45

45. R. Willett, M. E. Gehm, and D. J. Brady, “Multiscale reconstruction for computational spectral imaging,” in Electronic Imaging 2007, (International Society for Optics and Photonics, 2007), 64980L–64980L–64915. 1.

]. Further investigations along this line are highly desired.

Acknowledgments

We are grateful for the discussion with Dr. Ying Min Wang. For more information, please visit https://sites.google.com/site/gazheng/.

References and links

1.

G. Zheng, R. Horstmeyer, and C. Yang, “Wide-field, high-resolution Fourier ptychographic microscopy,” Nat. Photonics 7(9), 739–745 (2013). [CrossRef]

2.

M. Ryle and A. Hewish, “The synthesis of large radio telescopes,” Mon. Not. R. Astron. Soc. 120, 220 (1960).

3.

A. B. Meinel, “Aperture synthesis using independent telescopes,” Appl. Opt. 9(11), 2501 (1970). [CrossRef] [PubMed]

4.

R. Gerchberg, “A practical algorithm for the determination of phase from image and diffraction plane pictures,” Optik (Stuttg.) 35, 237 (1972).

5.

J. R. Fienup, “Reconstruction of an object from the modulus of its Fourier transform,” Opt. Lett. 3(1), 27–29 (1978). [CrossRef] [PubMed]

6.

L. Taylor, “The phase retrieval problem,” IEEE Trans. Antennas Propag. 29(2), 386–391 (1981). [CrossRef]

7.

J. R. Fienup, “Phase retrieval algorithms: a comparison,” Appl. Opt. 21(15), 2758–2769 (1982). [CrossRef] [PubMed]

8.

R. A. Gonsalves, “Phase retrieval and diversity in adaptive optics,” Opt. Eng. 21, 215829 (1982).

9.

R. A. Gonsalves, “Phase retrieval by differential intensity measurements,” J. Opt. Soc. Am. A. 4(1), 166–170 (1987). [CrossRef]

10.

L. Allen and M. Oxley, “Phase retrieval from series of images obtained by defocus variation,” Opt. Commun. 199(1-4), 65–75 (2001). [CrossRef]

11.

B. H. Dean and C. W. Bowers, “Diversity selection for phase-diverse phase retrieval,” J. Opt. Soc. Am. A 20(8), 1490–1504 (2003). [CrossRef] [PubMed]

12.

V. Elser, “Phase retrieval by iterated projections,” J. Opt. Soc. Am. A 20(1), 40–55 (2003). [CrossRef] [PubMed]

13.

L. Waller, S. S. Kou, C. J. R. Sheppard, and G. Barbastathis, “Phase from chromatic aberrations,” Opt. Express 18(22), 22817–22825 (2010). [CrossRef] [PubMed]

14.

C.-H. Lu, C. Barsi, M. O. Williams, J. N. Kutz, and J. W. Fleischer, “Phase retrieval using nonlinear diversity,” Appl. Opt. 52(10), D92–D96 (2013). [CrossRef] [PubMed]

15.

H. M. L. Faulkner and J. M. Rodenburg, “Movable Aperture Lensless Transmission Microscopy: A Novel Phase Retrieval Algorithm,” Phys. Rev. Lett. 93(2), 023903 (2004). [CrossRef] [PubMed]

16.

M. Guizar-Sicairos and J. R. Fienup, “Phase retrieval with transverse translation diversity: a nonlinear optimization approach,” Opt. Express 16(10), 7264–7278 (2008). [CrossRef] [PubMed]

17.

P. Thibault, M. Dierolf, A. Menzel, O. Bunk, C. David, and F. Pfeiffer, “High-Resolution Scanning X-Ray Diffraction Microscopy,” Science 321(5887), 379–382 (2008). [CrossRef] [PubMed]

18.

P. Thibault, M. Dierolf, O. Bunk, A. Menzel, and F. Pfeiffer, “Probe retrieval in ptychographic coherent diffractive imaging,” Ultramicroscopy 109(4), 338–343 (2009). [CrossRef] [PubMed]

19.

M. Dierolf, P. Thibault, A. Menzel, C. M. Kewish, K. Jefimovs, I. Schlichting, K. von König, O. Bunk, and F. Pfeiffer, “Ptychographic coherent diffractive imaging of weakly scattering specimens,” New J. Phys. 12(3), 035017 (2010). [CrossRef]

20.

A. M. Maiden, J. M. Rodenburg, and M. J. Humphry, “Optical ptychography: a practical implementation with useful resolution,” Opt. Lett. 35(15), 2585–2587 (2010). [CrossRef] [PubMed]

21.

F. Hüe, J. M. Rodenburg, A. M. Maiden, and P. A. Midgley, “Extended ptychography in the transmission electron microscope: Possibilities and limitations,” Ultramicroscopy 111(8), 1117–1123 (2011). [CrossRef] [PubMed]

22.

A. Shenfield and J. M. Rodenburg, “Evolutionary determination of experimental parameters for ptychographical imaging,” J. Appl. Phys. 109(12), 124510 (2011). [CrossRef]

23.

M. J. Humphry, B. Kraus, A. C. Hurst, A. M. Maiden, and J. M. Rodenburg, “Ptychographic electron microscopy using high-angle dark-field scattering for sub-nanometre resolution imaging,” Nat. Commun. 3, 730 (2012). [CrossRef] [PubMed]

24.

T. B. Edo, D. J. Batey, A. M. Maiden, C. Rau, U. Wagner, Z. D. Pešić, T. A. Waigh, and J. M. Rodenburg, “Sampling in x-ray ptychography,” Phys. Rev. A 87(5), 053850 (2013). [CrossRef]

25.

S. Marchesini, A. Schirotzek, C. Yang, H.- Wu, and F. Maia, “Augmented projections for ptychographic imaging,” Inverse Probl. 29(11), 115009 (2013). [CrossRef]

26.

W. Hoppe and G. Strube, “Diffraction in inhomogeneous primary wave fields. 2. Optical experiments for phase determination of lattice interferences,” Acta Crystallogr. A 25, 502–507 (1969). [CrossRef]

27.

J. M. Rodenburg and R. H. T. Bates, “The Theory of Super-Resolution Electron Microscopy Via Wigner-Distribution Deconvolution,” Philosoph. Trans. R. Soc. London. Ser. A: Phys. Eng. Sci. 339(1655), 521–553 (1992). [CrossRef]

28.

X. Ou, R. Horstmeyer, C. Yang, and G. Zheng, “Quantitative phase imaging via Fourier ptychographic microscopy,” Opt. Lett. 38(22), 4845–4848 (2013). [CrossRef] [PubMed]

29.

E. Wolf, “New theory of partial coherence in the space-frequency domain. Part I: spectra and cross spectra of steady-state sources,” J. Opt. Soc. Am. 72(3), 343–351 (1982). [CrossRef]

30.

L. W. Whitehead, G. J. Williams, H. M. Quiney, D. J. Vine, R. A. Dilanian, S. Flewett, K. A. Nugent, A. G. Peele, E. Balaur, and I. McNulty, “Diffractive Imaging Using Partially Coherent X Rays,” Phys. Rev. Lett. 103(24), 243902 (2009). [CrossRef] [PubMed]

31.

B. Abbey, L. W. Whitehead, H. M. Quiney, D. J. Vine, G. A. Cadenazzi, C. A. Henderson, K. A. Nugent, E. Balaur, C. T. Putkunz, A. G. Peele, G. J. Williams, and I. McNulty, “Lensless imaging using broadband X-ray sources,” Nat. Photonics 5(7), 420–424 (2011). [CrossRef]

32.

P. Thibault and A. Menzel, “Reconstructing state mixtures from diffraction measurements,” Nature 494(7435), 68–71 (2013). [CrossRef] [PubMed]

33.

D. J. Batey, D. Claus, and J. M. Rodenburg, “Information multiplexing in ptychography,” Ultramicroscopy 138, 13–21 (2014). [CrossRef] [PubMed]

34.

G. Zheng, “Breakthroughs in Photonics 2013: Fourier Ptychographic Imaging,” IEEE Photon. J. 6(2), 1–7 (2014). [CrossRef]

35.

S. Dong, Z. Bian, R. Shiradkar, and G. Zheng, “Sparsely sampled Fourier ptychography,” Opt. Express 22(5), 5455–5464 (2014). [CrossRef] [PubMed]

36.

Z. Bian, S. Dong, and G. Zheng, “Adaptive system correction for robust Fourier ptychographic imaging,” Opt. Express 21(26), 32400–32410 (2013). [CrossRef] [PubMed]

37.

M. N. Gurcan, L. E. Boucheron, A. Can, A. Madabhushi, N. M. Rajpoot, and B. Yener, “Histopathological image analysis: A review,” IEEE Rev. Biomed. Eng. 2, 147–171 (2009). [CrossRef] [PubMed]

38.

H. Akbari, L. V. Halig, D. M. Schuster, A. Osunkoya, V. Master, P. T. Nieh, G. Z. Chen, and B. Fei, “Hyperspectral imaging and quantitative analysis for prostate cancer detection,” J. Biomed. Opt. 17(7), 0760051 (2012). [CrossRef] [PubMed]

39.

F. Woolfe, M. Maggioni, G. Davis, F. Warner, R. Coifman, and S. Zucker, “Hyper-spectral microscopic discrimination between normal and cancerous colon biopsies,” IEEE Trans. Med. Imaging 99, 9999 (1999).

40.

D. T. Dicker, J. Lerner, P. Van Belle, S. F. Barth, D. Guerry 4th, M. Herlyn, D. E. Elder, and W. S. El-Deiry, “Differentiation of Normal Skin and Melanoma using High Resolution Hyperspectral Imaging,” Cancer Biol. Ther. 5(8), 1033–1038 (2006). [CrossRef] [PubMed]

41.

K. Hoshino, P. P. Joshi, G. Bhave, K. V. Sokolov, and X. Zhang, “Use of colloidal quantum dots as a digitally switched swept light source for gold nanoparticle based hyperspectral microscopy,” Biomed. Opt. Express 5(5), 1610–1615 (2014). [CrossRef]

42.

R. Baraniuk, “Compressive sensing,” IEEE Signal Process. Mag. 24(4), 118–121 (2007). [CrossRef]

43.

D. Brady and M. Gehm, “Compressive imaging spectrometers using coded apertures,” in Defense and Security Symposium, (International Society for Optics and Photonics, 2006), 62460A–62460A.

44.

M. Parmar, S. Lansel, and B. A. Wandell, “Spatio-spectral reconstruction of the multispectral datacube using sparse recovery,” in Image Processing,2008. ICIP 2008. 15th IEEE International Conference on, (IEEE, 2008), 473–476. [CrossRef]

45.

R. Willett, M. E. Gehm, and D. J. Brady, “Multiscale reconstruction for computational spectral imaging,” in Electronic Imaging 2007, (International Society for Optics and Photonics, 2007), 64980L–64980L–64915. 1.

OCIS Codes
(100.3190) Image processing : Inverse problems
(170.0180) Medical optics and biotechnology : Microscopy
(170.3010) Medical optics and biotechnology : Image reconstruction techniques
(110.4234) Imaging systems : Multispectral and hyperspectral imaging

ToC Category:
Microscopy

History
Original Manuscript: March 19, 2014
Revised Manuscript: May 4, 2014
Manuscript Accepted: May 5, 2014
Published: May 9, 2014

Citation
Siyuan Dong, Radhika Shiradkar, Pariksheet Nanda, and Guoan Zheng, "Spectral multiplexing and coherent-state decomposition in Fourier ptychographic imaging," Biomed. Opt. Express 5, 1757-1767 (2014)
http://www.opticsinfobase.org/boe/abstract.cfm?URI=boe-5-6-1757


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. G. Zheng, R. Horstmeyer, and C. Yang, “Wide-field, high-resolution Fourier ptychographic microscopy,” Nat. Photonics7(9), 739–745 (2013). [CrossRef]
  2. M. Ryle and A. Hewish, “The synthesis of large radio telescopes,” Mon. Not. R. Astron. Soc.120, 220 (1960).
  3. A. B. Meinel, “Aperture synthesis using independent telescopes,” Appl. Opt.9(11), 2501 (1970). [CrossRef] [PubMed]
  4. R. Gerchberg, “A practical algorithm for the determination of phase from image and diffraction plane pictures,” Optik (Stuttg.)35, 237 (1972).
  5. J. R. Fienup, “Reconstruction of an object from the modulus of its Fourier transform,” Opt. Lett.3(1), 27–29 (1978). [CrossRef] [PubMed]
  6. L. Taylor, “The phase retrieval problem,” IEEE Trans. Antennas Propag.29(2), 386–391 (1981). [CrossRef]
  7. J. R. Fienup, “Phase retrieval algorithms: a comparison,” Appl. Opt.21(15), 2758–2769 (1982). [CrossRef] [PubMed]
  8. R. A. Gonsalves, “Phase retrieval and diversity in adaptive optics,” Opt. Eng.21, 215829 (1982).
  9. R. A. Gonsalves, “Phase retrieval by differential intensity measurements,” J. Opt. Soc. Am. A.4(1), 166–170 (1987). [CrossRef]
  10. L. Allen and M. Oxley, “Phase retrieval from series of images obtained by defocus variation,” Opt. Commun.199(1-4), 65–75 (2001). [CrossRef]
  11. B. H. Dean and C. W. Bowers, “Diversity selection for phase-diverse phase retrieval,” J. Opt. Soc. Am. A20(8), 1490–1504 (2003). [CrossRef] [PubMed]
  12. V. Elser, “Phase retrieval by iterated projections,” J. Opt. Soc. Am. A20(1), 40–55 (2003). [CrossRef] [PubMed]
  13. L. Waller, S. S. Kou, C. J. R. Sheppard, and G. Barbastathis, “Phase from chromatic aberrations,” Opt. Express18(22), 22817–22825 (2010). [CrossRef] [PubMed]
  14. C.-H. Lu, C. Barsi, M. O. Williams, J. N. Kutz, and J. W. Fleischer, “Phase retrieval using nonlinear diversity,” Appl. Opt.52(10), D92–D96 (2013). [CrossRef] [PubMed]
  15. H. M. L. Faulkner and J. M. Rodenburg, “Movable Aperture Lensless Transmission Microscopy: A Novel Phase Retrieval Algorithm,” Phys. Rev. Lett.93(2), 023903 (2004). [CrossRef] [PubMed]
  16. M. Guizar-Sicairos and J. R. Fienup, “Phase retrieval with transverse translation diversity: a nonlinear optimization approach,” Opt. Express16(10), 7264–7278 (2008). [CrossRef] [PubMed]
  17. P. Thibault, M. Dierolf, A. Menzel, O. Bunk, C. David, and F. Pfeiffer, “High-Resolution Scanning X-Ray Diffraction Microscopy,” Science321(5887), 379–382 (2008). [CrossRef] [PubMed]
  18. P. Thibault, M. Dierolf, O. Bunk, A. Menzel, and F. Pfeiffer, “Probe retrieval in ptychographic coherent diffractive imaging,” Ultramicroscopy109(4), 338–343 (2009). [CrossRef] [PubMed]
  19. M. Dierolf, P. Thibault, A. Menzel, C. M. Kewish, K. Jefimovs, I. Schlichting, K. von König, O. Bunk, and F. Pfeiffer, “Ptychographic coherent diffractive imaging of weakly scattering specimens,” New J. Phys.12(3), 035017 (2010). [CrossRef]
  20. A. M. Maiden, J. M. Rodenburg, and M. J. Humphry, “Optical ptychography: a practical implementation with useful resolution,” Opt. Lett.35(15), 2585–2587 (2010). [CrossRef] [PubMed]
  21. F. Hüe, J. M. Rodenburg, A. M. Maiden, and P. A. Midgley, “Extended ptychography in the transmission electron microscope: Possibilities and limitations,” Ultramicroscopy111(8), 1117–1123 (2011). [CrossRef] [PubMed]
  22. A. Shenfield and J. M. Rodenburg, “Evolutionary determination of experimental parameters for ptychographical imaging,” J. Appl. Phys.109(12), 124510 (2011). [CrossRef]
  23. M. J. Humphry, B. Kraus, A. C. Hurst, A. M. Maiden, and J. M. Rodenburg, “Ptychographic electron microscopy using high-angle dark-field scattering for sub-nanometre resolution imaging,” Nat. Commun.3, 730 (2012). [CrossRef] [PubMed]
  24. T. B. Edo, D. J. Batey, A. M. Maiden, C. Rau, U. Wagner, Z. D. Pešić, T. A. Waigh, and J. M. Rodenburg, “Sampling in x-ray ptychography,” Phys. Rev. A87(5), 053850 (2013). [CrossRef]
  25. S. Marchesini, A. Schirotzek, C. Yang, H.- Wu, and F. Maia, “Augmented projections for ptychographic imaging,” Inverse Probl.29(11), 115009 (2013). [CrossRef]
  26. W. Hoppe and G. Strube, “Diffraction in inhomogeneous primary wave fields. 2. Optical experiments for phase determination of lattice interferences,” Acta Crystallogr. A25, 502–507 (1969). [CrossRef]
  27. J. M. Rodenburg and R. H. T. Bates, “The Theory of Super-Resolution Electron Microscopy Via Wigner-Distribution Deconvolution,” Philosoph. Trans. R. Soc. London. Ser. A: Phys. Eng. Sci.339(1655), 521–553 (1992). [CrossRef]
  28. X. Ou, R. Horstmeyer, C. Yang, and G. Zheng, “Quantitative phase imaging via Fourier ptychographic microscopy,” Opt. Lett.38(22), 4845–4848 (2013). [CrossRef] [PubMed]
  29. E. Wolf, “New theory of partial coherence in the space-frequency domain. Part I: spectra and cross spectra of steady-state sources,” J. Opt. Soc. Am.72(3), 343–351 (1982). [CrossRef]
  30. L. W. Whitehead, G. J. Williams, H. M. Quiney, D. J. Vine, R. A. Dilanian, S. Flewett, K. A. Nugent, A. G. Peele, E. Balaur, and I. McNulty, “Diffractive Imaging Using Partially Coherent X Rays,” Phys. Rev. Lett.103(24), 243902 (2009). [CrossRef] [PubMed]
  31. B. Abbey, L. W. Whitehead, H. M. Quiney, D. J. Vine, G. A. Cadenazzi, C. A. Henderson, K. A. Nugent, E. Balaur, C. T. Putkunz, A. G. Peele, G. J. Williams, and I. McNulty, “Lensless imaging using broadband X-ray sources,” Nat. Photonics5(7), 420–424 (2011). [CrossRef]
  32. P. Thibault and A. Menzel, “Reconstructing state mixtures from diffraction measurements,” Nature494(7435), 68–71 (2013). [CrossRef] [PubMed]
  33. D. J. Batey, D. Claus, and J. M. Rodenburg, “Information multiplexing in ptychography,” Ultramicroscopy138, 13–21 (2014). [CrossRef] [PubMed]
  34. G. Zheng, “Breakthroughs in Photonics 2013: Fourier Ptychographic Imaging,” IEEE Photon. J.6(2), 1–7 (2014). [CrossRef]
  35. S. Dong, Z. Bian, R. Shiradkar, and G. Zheng, “Sparsely sampled Fourier ptychography,” Opt. Express22(5), 5455–5464 (2014). [CrossRef] [PubMed]
  36. Z. Bian, S. Dong, and G. Zheng, “Adaptive system correction for robust Fourier ptychographic imaging,” Opt. Express21(26), 32400–32410 (2013). [CrossRef] [PubMed]
  37. M. N. Gurcan, L. E. Boucheron, A. Can, A. Madabhushi, N. M. Rajpoot, and B. Yener, “Histopathological image analysis: A review,” IEEE Rev. Biomed. Eng.2, 147–171 (2009). [CrossRef] [PubMed]
  38. H. Akbari, L. V. Halig, D. M. Schuster, A. Osunkoya, V. Master, P. T. Nieh, G. Z. Chen, and B. Fei, “Hyperspectral imaging and quantitative analysis for prostate cancer detection,” J. Biomed. Opt.17(7), 0760051 (2012). [CrossRef] [PubMed]
  39. F. Woolfe, M. Maggioni, G. Davis, F. Warner, R. Coifman, and S. Zucker, “Hyper-spectral microscopic discrimination between normal and cancerous colon biopsies,” IEEE Trans. Med. Imaging99, 9999 (1999).
  40. D. T. Dicker, J. Lerner, P. Van Belle, S. F. Barth, D. Guerry, M. Herlyn, D. E. Elder, and W. S. El-Deiry, “Differentiation of Normal Skin and Melanoma using High Resolution Hyperspectral Imaging,” Cancer Biol. Ther.5(8), 1033–1038 (2006). [CrossRef] [PubMed]
  41. K. Hoshino, P. P. Joshi, G. Bhave, K. V. Sokolov, and X. Zhang, “Use of colloidal quantum dots as a digitally switched swept light source for gold nanoparticle based hyperspectral microscopy,” Biomed. Opt. Express5(5), 1610–1615 (2014). [CrossRef]
  42. R. Baraniuk, “Compressive sensing,” IEEE Signal Process. Mag.24(4), 118–121 (2007). [CrossRef]
  43. D. Brady and M. Gehm, “Compressive imaging spectrometers using coded apertures,” in Defense and Security Symposium, (International Society for Optics and Photonics, 2006), 62460A–62460A.
  44. M. Parmar, S. Lansel, and B. A. Wandell, “Spatio-spectral reconstruction of the multispectral datacube using sparse recovery,” in Image Processing,2008. ICIP 2008. 15th IEEE International Conference on, (IEEE, 2008), 473–476. [CrossRef]
  45. R. Willett, M. E. Gehm, and D. J. Brady, “Multiscale reconstruction for computational spectral imaging,” in Electronic Imaging 2007, (International Society for Optics and Photonics, 2007), 64980L–64980L–64915. 1.

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.


« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited