Correlation Analysis in Contaminated Data by Singular Spectrum Analysis.

Rodrigues, Paulo Canas; Mahmoudvand, Rahim

Correlation analysis is one of the standard and most informative descriptive statistical tools when studying relationships between variables in bivariate and multivariate data. However, when data is contaminated with outlying observations, the standard Pearson correlation might be misleading and result in erroneous outcomes. In this paper, we propose three new approaches to find linear correlation based on the nonparametric method designed to analyse time series data, the singular spectrum analysis. In these proposals, the correlation is obtained after removing the noise from the data by using singular spectrum analysis based methods. The usefulness of our proposals in contaminated data is assessed by Monte Carlo simulation with different schemes of contamination, and with applications to real data on aluminium industry and synthetic sparse data. In addition, the model comparisons are made with robust hybrid filtering methods. Copyright © 2016 John Wiley & Sons, Ltd.

STATISTICAL correlation; SPECTRUM analysis; DATA analysis; BIVARIATE analysis; MATHEMATICAL variables; MULTIVARIATE analysis; MONTE Carlo method

Quality & Reliability Engineering International, 2016, Vol 32, Issue 6, p2127

0748-8017

Academic Journal

10.1002/qre.2027