In:
Statistica Neerlandica, Wiley, Vol. 76, No. 3 ( 2022-08), p. 347-368
Abstract:
We developed a novel method to address multicollinearity in linear models called average ordinary least squares (OLS)‐centered penalized regression (AOPR). AOPR penalizes the cost function to shrink the estimators toward the weighted‐average OLS estimator. The commonly used ridge regression (RR) shrinks the estimators toward zero, that is, employs penalization prior in the Bayesian view, which contradicts the common real prior . Therefore, RR selects small penalization coefficients to relieve such a contradiction and thus makes the penalizations inadequate. Mathematical derivations remind us that AOPR could increase the performance of RR and OLS regression. A simulation study shows that AOPR obtains more accurate estimators than OLS regression in most situations and more accurate estimators than RR when the signs of the true s are identical and is slightly less accurate than RR when the signs of the true s are different. Additionally, a case study shows that AOPR obtains more stable estimators and stronger statistical power and predictive ability than RR and OLS regression. Through these results, we recommend using AOPR to address multicollinearity more efficiently than RR and OLS regression, especially when the true s have identical signs.
Type of Medium:
Online Resource
ISSN:
0039-0402
,
1467-9574
Language:
English
Publisher:
Wiley
Publication Date:
2022
detail.hit.zdb_id:
1466958-4
SSG:
7,23
Permalink
