Abstract

Spectrophotometric data are inherently heteroscedastic, which means that least-squares component analyses of absorbance spectra should properly employ weighted fits. The effects of neglecting weights (the common practice) is examined through Monte Carlo calculations on a three-peak model having two closely overlapping components of comparable strength and a third component that appears as a weak shoulder. The results show statistically significant loss of precision in all parameters; however the magnitude of this loss is ≲30% for realistic conditions. For comparison, experimental spectra of I₂ in CCl₄ (which was the basis for the Monte Carlo test model) are similarly analyzed. These results suggest that model inadequacy is likely to be a greater practical problem than neglect of weights, because the great precision of spectrophotometric data places extreme demands on the fit model. In the present instance, for example, incorporation of a correction term for the sinusoidal error in the spectrometer wavelength significantly reduces the fit chi-square.

Numerical analysis and estimation of the statistical error of differential optical absorption spectroscopy measurements with least-squares methods

Jochen Stutz and Ulrich Platt
Appl. Opt. 35(30) 6041-6053 (1996)

Weighted-least-squares phase reconstruction from the bispectrum

Charles L. Matson
J. Opt. Soc. Am. A 8(12) 1905-1913 (1991)

Computer Analysis of Resonance Profiles by the Method of Least Squares

David L. Ederer
Appl. Opt. 8(11) 2315-2325 (1969)

Accuracy of maximum likelihood and least-squares estimates in the lidar slope method with noisy data

Wynn L. Eberhard
Appl. Opt. 56(10) 2667-2685 (2017)

Nonlinear least squares analysis of atmospheric absorption spectra

E. Niple
Appl. Opt. 19(20) 3481-3490 (1980)