Rank theory approach to ridge, LASSO, preliminary test and Stein-type estimators: Comparative study

Varování

Publikace nespadá pod Fakultu sportovních studií, ale pod Přírodovědeckou fakultu. Oficiální stránka publikace je na webu muni.cz.
Autoři

SALEH A.K.Md.Ehsanes NAVRÁTIL Radim

Rok publikování 2018
Druh Článek v odborném periodiku
Časopis / Zdroj KYBERNETIKA
Fakulta / Pracoviště MU

Přírodovědecká fakulta

Citace
www https://www.kybernetika.cz/content/2018/5/958
Doi http://dx.doi.org/10.14736/kyb-2018-5-0958
Klíčová slova efficiency of LASSO; penalty estimators; preliminary test; Stein-type estimator; ridge estimator; L-2-risk function
Popis In the development of efficient predictive models, the key is to identify suitable predictors for a given linear model. For the first time, this paper provides a comparative study of ridge regression, LASSO, preliminary test and Stein-type estimators based on the theory of rank statistics. Under the orthonormal design matrix of a given linear model, we find that the rank based ridge estimator outperforms the usual rank estimator, restricted R-estimator, rank-based LASSO, preliminary test and Stein-type R-estimators uniformly. On the other hand, neither LASSO nor the usual R-estimator, preliminary test and Stein-type R-estimators outperform the other. The region of domination of LASSO over all the R-estimators (except the ridge R-estimator) is the interval around the origin of the parameter space. Finally, we observe that the L-2-risk of the restricted R-estimator equals the lower bound on the L-2-risk of LASSO. Our conclusions are based on L-2-risk analysis and relative L-2-risk efficiencies with related tables and graphs.
Související projekty:

Používáte starou verzi internetového prohlížeče. Doporučujeme aktualizovat Váš prohlížeč na nejnovější verzi.

Další info