Abstract

The spectra in spectral reflectance datasets tend to be quite correlated and therefore they can be represented more compactly using standard techniques such as principal components analysis (PCA) as part of a lossy compression strategy. However, the presence of outlier spectra can often increase the overall error of the reconstructed spectra. This paper introduces a new outlier modeling (OM) method that detects, clusters, and separately models outliers with their own set of basis vectors. Outliers are defined in terms of the robust Mahalanobis distance using the fast minimum covariance determinant algorithm as a robust estimator of the multivariate mean and covariance from which it is computed. After removing the outliers from the main dataset, the performance of PCA on the remaining data improves significantly; however, since outlier spectra are a part of the image, they cannot simply be ignored. The solution is to cluster the outliers into a small number of clusters and then model each cluster separately using its own cluster-specific PCA-derived bases. Tests show that OM leads to lower spectral reconstruction errors of reflectance spectra in terms of both normalized RMS and goodness of fit.

© 2014 Optical Society of America

Reduced-order spectral data modeling based on local proper orthogonal decomposition

Woon Cho, Samir Sahyoun, Seddik M. Djouadi, Andreas Koschan, and Mongi A. Abidi
J. Opt. Soc. Am. A 32(5) 733-740 (2015)

Reconstruction of total radiance spectra of fluorescent samples by means of nonlinear principal component analysis

Marjan Barakzehi, Seyed Hossein Amirshahi, Shahram Peyvandi, and Mansoureh Ghanbar Afjeh
J. Opt. Soc. Am. A 30(9) 1862-1870 (2013)

Reconstruction of reflectance data using an interpolation technique

Farhad Moghareh Abed, Seyed Hossein Amirshahi, and Mohammad Reza Moghareh Abed
J. Opt. Soc. Am. A 26(3) 613-624 (2009)

Evaluating logarithmic kernel for spectral reflectance estimation—effects on model parametrization, training set size, and number of sensor spectral channels

Timo Eckhard, Eva M. Valero, Javier Hernández-Andrés, and Ville Heikkinen
J. Opt. Soc. Am. A 31(3) 541-549 (2014)

Updated version of an interim connection space LabPQR for spectral color reproduction: LabLab

Qian Cao, Xiaoxia Wan, Junfeng Li, and Jingxing Liang
J. Opt. Soc. Am. A 33(9) 1860-1871 (2016)