Data Transformation Technique to Improve the Outlier Detection Power of Grubbs’ Test for Data Expected to Follow Linear Relation
Методика преобразования данных для повышения эффективности выявления выбросов с помощью критерия Граббса для данных, предположительно соответствующих линейной зависимости
2015-01-01
SCID: 54.1/dxq62gmk
Discuss with AI
Grubbs' testdata transformationlinear relationoutlier detectiontime series
Figures from the paper
Abstract (AI)
Grubbs test (extreme studentized deviate test, maximum normed residual test) is used in various fields to identify outliers in a data set, which are ranked in the order of x 1 ≤ x 2 ≤ x 3 ≤ ⋯ ≤ x n ( i = 1,2 , 3 , … , n ) . However, ranking of data eliminates the actual sequence of a data series, which is an important factor for determining outliers in some cases (e.g., time series). Thus in such a data set, Grubbs test will not identify outliers correctly. This paper introduces a technique for transforming data from sequence bound linear form to sequence unbound form ( y = c ) . Applying Grubbs test to the new transformed data set detects outliers more accurately. In addition, the new technique improves the outlier detection capability of Grubbs test. Results show that, Grubbs test was capable of identifing outliers at significance level 0.01 after transformation, while it was unable to identify those prior to transforming at significance level 0.05.
Key Findings
1
Applying Grubbs’ test after transformation detects outliers more accurately by preserving the relevant deviation structure without sequence dependence.
2
Ranking data for Grubbs’ test discards sequence information, causing incorrect outlier identification in datasets expected to follow linear relations, including time series.
3
The paper introduces a transformation from a sequence-dependent linear form to a sequence-independent constant form (y = c).
4
The transformation improves Grubbs’ test sensitivity: outliers were identified at significance level 0.01 after transformation, whereas they were not identified at 0.05 before transformation.
Research Object
Data expected to follow a linear relation, including sequence-bound time-series data
Research Subject
Improved outlier-detection power of Grubbs’ test through transformation from a sequence-bound linear form to a sequence-unbound constant form
Publication Details
Publication Date
2015-01-01
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest