OSA's Digital Library

Optics Express

Optics Express

  • Editor: Andrew M. Weiner
  • Vol. 22, Iss. 7 — Apr. 7, 2014
  • pp: 7617–7624
« Show journal navigation

A statistical model for removing inter-device differences in spectroscopy

Lu Wang, Jong Soo Lee, Pierre Lane, E. Neely Atkinson, Andres Zuluaga, Michele Follen, Calum MacAulay, and Dennis D. Cox  »View Author Affiliations


Optics Express, Vol. 22, Issue 7, pp. 7617-7624 (2014)
http://dx.doi.org/10.1364/OE.22.007617


View Full Text Article

Acrobat PDF (1440 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations

Abstract

We are investigating spectroscopic devices designed to make in vivo cervical tissue measurements to detect pre-cancerous and cancerous lesions. All devices have the same design and ideally should record identical measurements. However, we observed consistent differences among them. An experiment was designed to study the sources of variation in the measurements recorded. Here we present a log additive statistical model that incorporates the sources of variability we identified. Based on this model, we estimated correction factors from the experimental data needed to eliminate the inter-device variability and other sources of variation. These correction factors are intended to improve the accuracy and repeatability of such devices when making future measurements on patient tissue.

© 2014 Optical Society of America

1. Introduction

The goal of our group is to develop technology to diagnose pre-cancerous and cancerous cervical lesions with in vivo spectroscopic measurements. This technology utilizes reflectance and fluorescence spectroscopy to assess tissue emission intensity at certain excitation, emission and remittance wavelengths [1

1. J. A. Freeberg, D. M. Serachitopol, N. McKinnon, R. Price, E. N. Atkinson, D. D. Cox, C. MacAulay, R. Richards-Kortum, M. Follen, and B. Pikkula, “Fluorescence and reflectance device variability throughout the progression of a phase II clinical trial to detect and screen for cervical neoplasia using a fiber optic probe,” J. Biomed. Opt. 12(3), 034015 (2007). [CrossRef] [PubMed]

]. We call the current generation of these devices Multispectral Digital Colposcope 3 (MDC3). Details may be found in [2

2. J. M. Yamal, G. A. Zewdie, D. D. Cox, E. N. Atkinson, S. B. Cantor, C. MacAulay, K. Davies, I. Adewole, T. P. Buys, and M. Follen, “Accuracy of optical spectroscopy for the detection of cervical intraepithelial neoplasia without colposcopic tissue information; a step toward automation for low resource settings,” J. Biomed. Opt. 17(4), 047002 (2012). [CrossRef] [PubMed]

4

4. B. Yu, H. Fu, T. Bydlon, J. E. Bender, and N. Ramanujam, “Diffuse reflectance spectroscopy with a self-calibrating fiber optic probe,” Opt. Lett. 33(16), 1783–1785 (2008). [CrossRef] [PubMed]

]. One issue with the MDC3 is that the shape and amplitude of the recorded spectra are different across devices for the same target. Therefore, device specific “correction factors” are needed to make the measurements consistent across devices.

For purposes of calibration and quality assurance, we make measurements on a daily basis from square Teflon tiles doped with two types of inorganic fluorophores. There are 4 such tiles that we refer to as “standards”. We conducted an experiment in which we repeatedly measured the reflectance and fluorescence spectra from these standards. We present a model to estimate correction factors for each device and standard. This statistical model provides a unified way to incorporate the different sources of variation and to assess the accuracy of the estimates. The correction factors will be used to remove the systematic differences between devices.

2. Materials and methods

2.1 Device description

We have four MDC3 devices and four measurement standards. The four MDC devices were manufactured in a single production run. The standards were ordered in two batches to identical specifications. In clinical use, we measure the standards prior to tissue measurement for quality assurance and standardization. Ideally, the devices and standards would be identical, but there are systematic differences.

2.2 Design of experiment

We conducted an experiment to assess repeatability of the standards measurements. In order to assess differences between both devices and standards, we measured each standard with each device. To account for time trends, we made repeated measurements over the day in three sessions: morning, mid-day and evening. The standard is kept in a plastic receptacle that has an opening into which the probe is inserted to make a measurement (Fig. 1). Because of possible effects from variable contact of the probe with the standard, we made five sets of five measurements for each session. For a given set the probe was kept in the receptacle to make five measurements; between sets, the probe was removed and reinserted. Therefore, there are 4 devices × 4 standards × 3 time sessions × 5 sets × of 5 measurements = 1200 spectra measured for each illumination detection filter set.

Data processing includes background subtraction and wavelength calibration (from pixel location in the spectrometer to wavelength in nanometers). To correct the measurements for variation in the intensity of illumination power all the measurements were to be divided by the power meter measurement. Due to missing values and quality control issues for some of the optical power measurements, 82 measurements were removed, leaving 1118 measurements.

2.3 Log additive model

We assume a linear response for the device that is wavelength dependent with no additive terms (it is assumed that offsets are removed by background subtraction). Illumination amplitude fluctuations are multiplicative factors that are constant across emission wavelengths. Taking logarithms turns these multiplicative relations into additive effects. Taking logarithms also reduces dynamic range and makes the variances more uniform. We posit the following log additive model for measurements from each filter set:

yijk(λ)=logYijk(λ)=μ(λ)+lCFDi(λ)+lCFSj(λ)+lACijk+εijk(λ)
(1)

where

  • Yijk(λ) = measured intensity at wavelength λ.
  • i, j = 1,2,3,4 for 4 devices and 4 standards respectively.
  • k = 1, …, Nij, indexes for measurement number for device i and standard j.
  • λ = wavelength in nanometers.
  • μ(λ) = grand mean for log of all measurements in a single filter set.
  • lCFDi(λ) = log of correction factor based on device i.
  • lCFSj(λ) = log of correction factor based on standard j.
  • lACijk = log of amplitude correction factor.
  • εijk(λ) = unexplained variation.

There are no terms in the model for each session or the set within each session. Our results in section 3 suggested that the time effects are subsumed in the lACijk terms. We will analyze those to assess if there are any effects from session and set. Using this log additive model, it is straight forward to estimate the correction factors and to apply standard statistical methods to assess the accuracy of estimates.

2.4 Model estimation

To calculate the estimates of each term in Eq. (1) we use analysis of variance (ANOVA) [5

5. J. L. Devore, Probability and Statistics for Engineering and the Sciences (Cengage Learning, 2011, 8th ed.), Chap.11.

] software. The first step is to fit the wavelength dependent correction factors lCFD and lCFS. Let μ^(λ) be the average of the log of all the measurement at each wavelength, then we have
lCF^Di(λ)=(j=14k=1Nijyijk(λ)j=14Nijμ^(λ)),lCF^Sj(λ)=(i=14k=1Nijyijk(λ)i=14Nijμ^(λ))
(2)
with Nij = number of measurements for device i and standard j. At each wavelengthλ, put
ε^ijk(1)(λ)=yijk(λ)μ^(λ)lCF^Di(λ)lCF^Sj(λ)
(3)
The log of amplitude correction is given by lAC^ijk=nλ1λε^ijk(1)(λ)with nλ being the number of emission wavelengths. The residual is ε^ijk(λ)=ε^ijk(1)(λ)lAC^ijk. The corrected spectra are then given by

logYijkCF(λ)=logYijk(λ)lCF^Di(λ)lCF^Sj(λ)lAC^ijk
(4)

3. Results

We made repeated measurements as described above. Filter set 1, the white reflectance data, has the most complicated shape as shown in the left plot of Fig. 2
Fig. 2 Plots of the measured spectra color-coded by device.
. For the fluorescence filter sets, filter set 4 has the widest range of emission wavelengths and encompasses all of the structure observed in filter sets 2 and 3. Therefore, we only present the results of filter sets 1 and 4. Below are the plots of the original measurements after pre-processing:

Note that all plots are in semi-log scale, so the units on the vertical axis are real and not logarithmic. In Fig. 3
Fig. 3 (a) (b) - light intensities after applying the correction factors (Log10 plot with original y-axis scale); (c) (d) - residuals plotted by devices in same scale.
, the left hand plots show the corrected spectra as given by Eq. (4) and right plots show the residuals defined above. In the left two plots in Fig. 3, the measurements align very well: we mostly see the blue color for device 4 because it was plotted last.

In the Table 2

Table 2. Percentage of variance explained by each factor (averaged across wavelength)

table-icon
View This Table
| View All Tables
below, we show the average of percentage of variance explained by each factor. The effects of device and standard explained most of the variation, which shows the correction factors are effective for removing most of the variation.

Figure 4
Fig. 4 Correction factors by device (exp(lCFDi(λ)) and standard (exp(lCFSj(λ)), with 95% confidence intervals.
shows the estimates of correction factors by device and standard and their corresponding 95% confidence intervals. The 95% confidence intervals are given by:

lCF^Di(λ)±1.96(1wi)2var(y¯i)+jiwj2var(y¯j)
(5)

with

y¯i(λ)=j=14k=1Nijyijk(λ)j=14Nij,wi=j=14Niji=14j=14Nij,var(y¯i)=j=14k=1Nijε^ijk2(λ)j=14Nij1.
(6)

The amplitude correction factors are very similar across all filter sets, but they show random patterns across session of the day and sets of measurements (Fig. 5
Fig. 5 Amplitude correction factors (ACijk = exp(lAC ijk)) estimates for filter set 1. The red lines separate the sessions. The color codes indicate sets of 5 measurements. Missing values are left blank.
).

In the plot above, we picked some device and standard combinations from filter set 1 to show how the amplitude correction estimates vary. The fluctuations in amplitude suggest that we cannot use these estimates to make any consistent corrections to patient measurements.

4. Discussion and conclusions

4.1 Application of the model

The log additive model we proposed provides a unified approach to estimate the correction factors along with accuracy assessments, i.e. confidence intervals. There are three general components to the model from the effects of the device, the standard and the amplitude fluctuations. The first two can be reliably used to correct the differences between devices and standards. After we applied the correction factor to the raw measurements, the curves align very well.

The plot of the correction factors for device and standard (Fig. 3) both show some overall patterns. Device correction factors oscillate along the emission wavelength for all filter sets and devices and some of them show upward or downward trends. The oscillating pattern of CFDi(λ) is likely due to the slight differences in lamp spectra and the spectral transmission of the components in the optical pathway, particularly the interference coatings on the hot mirror, excitation-emission filters, and the anti-reflection coatings on the projection and collimation lens elements. The correction factor for device 2 (CFD2(λ)) has a different trend compared to the other three. Later we found that this was because one of the elements in the excitation projection lens was positioned in a backward position. This was then corrected.

Standard correction factors are quite different across filter sets. Correction factors for filter set 1 are all small in magnitude. Standards 1 and 2, which were ordered in the first batch, apparently have higher level of fluorophores than standards 3 and 4, which were in the later batch, and the relative concentrations of the fluorophores vary across the batches. We believe this variation reflects batch to batch differences that one can expect to occur.

One important application is to use these estimates for quality control purposes. Our recommendation is when taking a new standard measurement, take the log10 of the spectra and then subtract out both the device and standard correction factors and log10 of the grand mean, if the result is outside of a certain confidence range, we will classify the measurement as an outlier and recommend a repeat measurement. This confidence range is calculated as the six-sigma [6

6. B. G. Lipták, Instrument Engineers' Handbook, Volume Two: Process Control and Optimization. (CRC Press, 2010.)

] interval for the amplitude correction estimates from our experiment for the given device and standard.

During the patient measurement in the clinic, we propose to make one standard measurement right before the patient in vivo tissue measurement. For this standard measurement, if we don’t reject it based on the above criteria, the patient tissue measurement will be multiplied by 10-lCFD to obtain the device corrected spectrum.

4.2 Further investigations

One problem with this model is that the residual variance is not constant across all emission wavelengths. We could use a wavelength dependent weight to refine the model fitting with a two-stage algorithm.

There is also an issue with updating the correction factor estimates. Since we suggest taking a standard measurement right before the patient measurement and we believe the device performance may change over time, it may give greater accuracy if our estimated correction factors evolve accordingly.

Acknowledgments

The authors gratefully acknowledge the support from NIH-NCI Grant No. P01-CA82710 from the National Cancer Institute. The authors appreciate the suggestions from Dr. Scott B. Cantor which enhanced the clarity of the manuscript.

References and links

1.

J. A. Freeberg, D. M. Serachitopol, N. McKinnon, R. Price, E. N. Atkinson, D. D. Cox, C. MacAulay, R. Richards-Kortum, M. Follen, and B. Pikkula, “Fluorescence and reflectance device variability throughout the progression of a phase II clinical trial to detect and screen for cervical neoplasia using a fiber optic probe,” J. Biomed. Opt. 12(3), 034015 (2007). [CrossRef] [PubMed]

2.

J. M. Yamal, G. A. Zewdie, D. D. Cox, E. N. Atkinson, S. B. Cantor, C. MacAulay, K. Davies, I. Adewole, T. P. Buys, and M. Follen, “Accuracy of optical spectroscopy for the detection of cervical intraepithelial neoplasia without colposcopic tissue information; a step toward automation for low resource settings,” J. Biomed. Opt. 17(4), 047002 (2012). [CrossRef] [PubMed]

3.

B. Yu, H. L. Fu, and N. Ramanujam, “Instrument independent diffuse reflectance spectroscopy,” J. Biomed. Opt. 16(1), 011010 (2011). [CrossRef] [PubMed]

4.

B. Yu, H. Fu, T. Bydlon, J. E. Bender, and N. Ramanujam, “Diffuse reflectance spectroscopy with a self-calibrating fiber optic probe,” Opt. Lett. 33(16), 1783–1785 (2008). [CrossRef] [PubMed]

5.

J. L. Devore, Probability and Statistics for Engineering and the Sciences (Cengage Learning, 2011, 8th ed.), Chap.11.

6.

B. G. Lipták, Instrument Engineers' Handbook, Volume Two: Process Control and Optimization. (CRC Press, 2010.)

OCIS Codes
(030.6600) Coherence and statistical optics : Statistical optics
(120.4800) Instrumentation, measurement, and metrology : Optical standards and testing
(170.4440) Medical optics and biotechnology : ObGyn
(170.6510) Medical optics and biotechnology : Spectroscopy, tissue diagnostics

ToC Category:
Medical Optics and Biotechnology

History
Original Manuscript: January 23, 2014
Revised Manuscript: March 13, 2014
Manuscript Accepted: March 16, 2014
Published: March 25, 2014

Virtual Issues
Vol. 9, Iss. 6 Virtual Journal for Biomedical Optics

Citation
Lu Wang, Jong Soo Lee, Pierre Lane, E. Neely Atkinson, Andres Zuluaga, Michele Follen, Calum MacAulay, and Dennis D. Cox, "A statistical model for removing inter-device differences in spectroscopy," Opt. Express 22, 7617-7624 (2014)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-22-7-7617


Sort:  Author  |  Year  |  Journal  |  Reset  

References

  1. J. A. Freeberg, D. M. Serachitopol, N. McKinnon, R. Price, E. N. Atkinson, D. D. Cox, C. MacAulay, R. Richards-Kortum, M. Follen, B. Pikkula, “Fluorescence and reflectance device variability throughout the progression of a phase II clinical trial to detect and screen for cervical neoplasia using a fiber optic probe,” J. Biomed. Opt. 12(3), 034015 (2007). [CrossRef] [PubMed]
  2. J. M. Yamal, G. A. Zewdie, D. D. Cox, E. N. Atkinson, S. B. Cantor, C. MacAulay, K. Davies, I. Adewole, T. P. Buys, M. Follen, “Accuracy of optical spectroscopy for the detection of cervical intraepithelial neoplasia without colposcopic tissue information; a step toward automation for low resource settings,” J. Biomed. Opt. 17(4), 047002 (2012). [CrossRef] [PubMed]
  3. B. Yu, H. L. Fu, N. Ramanujam, “Instrument independent diffuse reflectance spectroscopy,” J. Biomed. Opt. 16(1), 011010 (2011). [CrossRef] [PubMed]
  4. B. Yu, H. Fu, T. Bydlon, J. E. Bender, N. Ramanujam, “Diffuse reflectance spectroscopy with a self-calibrating fiber optic probe,” Opt. Lett. 33(16), 1783–1785 (2008). [CrossRef] [PubMed]
  5. J. L. Devore, Probability and Statistics for Engineering and the Sciences (Cengage Learning, 2011, 8th ed.), Chap.11.
  6. B. G. Lipták, Instrument Engineers' Handbook, Volume Two: Process Control and Optimization. (CRC Press, 2010.)

Cited By

Alert me when this paper is cited

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

Figures

Fig. 1 Fig. 2 Fig. 3
 
Fig. 4 Fig. 5
 

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited