Knowledge Center Catalog

Local cover image
Local cover image

HDBRR : a statistical package for high-dimensional Bayesian ridge regression without MCMC

By: Contributor(s): Material type: ArticleArticleLanguage: English Publication details: Taylor and Francis Ltd., 2022. United Kingdom :ISSN:
  • 0094-9655
  • 1563-5163 (Online)
Subject(s): In: Journal of Statistical Computation and Simulation v. 92, no. 17, p. 3679-3705Summary: Ridge regression dealswith collinearity in the homoscedastic linear regression model. When the number of predictors (p) is much larger than the number of observations (n), it  gives unique least-square estimators.  From both, classical and Bayesian approaches, parameter estimation is a highly demanding computational task, in the first one being an optimization problem and in the second one a high-dimensional integration problem usually faced up through Markov chain Monte Carlo (MCMC). The main drawback of MCMC is the practical impossibility of checking convergence to the posterior distribution, which is commonly very slow due to the large number of regression parameters. Here, a computational algorithm is proposed to obtain posterior estimates of regression parameters, variance components and predictions for the conventional ridge regression model. The algorithm is based on a reparametrization of the model which allows us to obtain the marginal posterior means and variances by integrating out a nuisance parameter whose marginal posterior is defined on the open interval (Formula presented.).
Tags from this library: No tags from this library for this title. Log in to add tags.
Star ratings
    Average rating: 0.0 (0 votes)
Holdings
Item type Current library Collection Call number Status Date due Barcode Item holds
Article CIMMYT Knowledge Center: John Woolston Library CIMMYT Staff Publications Collection Available
Total holds: 0

Peer review

Ridge regression dealswith collinearity in the homoscedastic linear regression model. When the number of predictors (p) is much larger than the number of observations (n), it  gives unique least-square estimators.  From both, classical and Bayesian approaches, parameter estimation is a highly demanding computational task, in the first one being an optimization problem and in the second one a high-dimensional integration problem usually faced up through Markov chain Monte Carlo (MCMC). The main drawback of MCMC is the practical impossibility of checking convergence to the posterior distribution, which is commonly very slow due to the large number of regression parameters. Here, a computational algorithm is proposed to obtain posterior estimates of regression parameters, variance components and predictions for the conventional ridge regression model. The algorithm is based on a reparametrization of the model which allows us to obtain the marginal posterior means and variances by integrating out a nuisance parameter whose marginal posterior is defined on the open interval (Formula presented.).

Text in English

Click on an image to view it in the image viewer

Local cover image

International Maize and Wheat Improvement Center (CIMMYT) © Copyright 2021.
Carretera México-Veracruz. Km. 45, El Batán, Texcoco, México, C.P. 56237.
If you have any question, please contact us at
CIMMYT-Knowledge-Center@cgiar.org