Data Transformation Technique to Improve the Outlier Detection Power of Grubbs’ Test for Data Expected to Follow Linear Relation

Методика преобразования данных для повышения эффективности выявления выбросов с помощью критерия Граббса для данных, предположительно соответствующих линейной зависимости
K. K. L. B. Adikaram, M. A. Hussein, Mathias Effenberger, Thomas Becker
2015-01-01

Grubbs' testdata transformationlinear relationoutlier detectiontime series
Grubbs test (extreme studentized deviate test, maximum normed residual test) is used in various fields to identify outliers in a data set, which are ranked in the order of x 1 ≤ x 2 ≤ x 3 ≤ ⋯ ≤ x n ( i = 1,2 , 3 , … , n ) . However, ranking of data eliminates the actual sequence of a data series, which is an important factor for determining outliers in some cases (e.g., time series). Thus in such a data set, Grubbs test will not identify outliers correctly. This paper introduces a technique for transforming data from sequence bound linear form to sequence unbound form ( y = c ) . Applying Grubbs test to the new transformed data set detects outliers more accurately. In addition, the new technique improves the outlier detection capability of Grubbs test. Results show that, Grubbs test was capable of identifing outliers at significance level 0.01 after transformation, while it was unable to identify those prior to transforming at significance level 0.05.
1
Applying Grubbs’ test after transformation detects outliers more accurately by preserving the relevant deviation structure without sequence dependence.
2
Ranking data for Grubbs’ test discards sequence information, causing incorrect outlier identification in datasets expected to follow linear relations, including time series.
3
The paper introduces a transformation from a sequence-dependent linear form to a sequence-independent constant form (y = c).
4
The transformation improves Grubbs’ test sensitivity: outliers were identified at significance level 0.01 after transformation, whereas they were not identified at 0.05 before transformation.

Data expected to follow a linear relation, including sequence-bound time-series data

Improved outlier-detection power of Grubbs’ test through transformation from a sequence-bound linear form to a sequence-unbound constant form

Publication Details
Publication Date
2015-01-01
Journal
Publisher
ISSN
Access Type
Author Information
Authors
K. K. L. B. Adikaram
M. A. Hussein
Mathias Effenberger
Thomas Becker
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%