A variance shift model for detection of outliers in the linear mixed model
A variance shift outlier model (VSOM), previously used for detecting outliers in the linear model, is extended to the variance components model. This VSOM accommodates outliers as observations with inflated variance, with the status of the th observation as an outlier indicated by the size of the associated shift in the variance. Likelihood ratio and score test statistics are assessed as objective measures for determining whether the th observation has inflated variance and is therefore an outlier. It is shown that standard asymptotic distributions do not apply to these tests for a VSOM, and a modified distribution is proposed. A parametric bootstrap procedure is proposed to account for multiple testing. The VSOM framework is extended to account for outliers in random effects and is shown to have an advantage over case-deletion approaches. A simulation study is presented to verify the performance of the proposed tests. Challenges associated with computation and extensions of the VSOM to the general linear mixed model with correlated errors are discussed.
| Item Type | Article |
|---|---|
| Open Access | Not Open Access |
| Keywords | Likelihood ratio test, Linear mixed model, Multiple testing, Outlier detection, REML, Score test, Variance shift outlier model |
| Project | Centre for Mathematical and Computational Biology (MCB), Development and extensions of linear mixed models |
| Date Deposited | 05 Dec 2025 09:43 |
| Last Modified | 19 Dec 2025 14:32 |
Explore Further
-
picture_as_pdf - 1-s2.0-S0167947310001210-main.pdf
-
subject - Published Version
-
lock - Restricted to Repository staff only
-
- Available under Creative Commons: Attribution 4.0

