An Evaluation of Ridge Regression

An Evaluation of Ridge Regression
Author: James R. Makin
Publisher:
Total Pages: 105
Release: 1981
Genre:
ISBN:

Download An Evaluation of Ridge Regression Book in PDF, Epub and Kindle

The technique of linear regression has been applied as a tool for predicting the cost of an item based on its most important characteristics. Often these characteristics (variables) tend to be highly intercorrelated (the data are said to exhibit multicollinearity) causing least squares estimates of the regression coefficients to be unstable and possibly leading to erroneous predictions. Ridge regression, a possible remedy for the problems caused by multicollinearity proposed by Hoerl and Kennard, is a biased estimation technique which reduces the variance of estimators and provides more precision (as measured by mean square error of the coefficients) than ordinary least squares (OLS) estimators. A comparison was made between these techniques to determine when ridge regression provides better cost equation coefficient estimates than OLS as a function of the degree of multicollinearity in the data, the number of predictor variables in the model, the degree of model fit (R2), and the amount of bias (k) of the estimate. A regression analysis of both sets showed that the degree of multicollinearity and amount of bias interact in explaining the major part of the improvement (degradation) in the mean square coefficient error.

An Evaluation of Ridge Estimators

An Evaluation of Ridge Estimators
Author: Joseph P. Newhouse
Publisher:
Total Pages: 28
Release: 1971
Genre: Estimation theory
ISBN:

Download An Evaluation of Ridge Estimators Book in PDF, Epub and Kindle

The report explores the statistical properties of a class of estimators, known as either ridge analysis or ridge regression, proposed as an alternative to ordinary least squares (OLS) regression in analyzing sample data that are collinear. Using Monte Carlo techniques, various ridge estimation procedures were evaluated. All the ridge estimators did worse than OLS for at least some choices of the true regression coefficient in the models considered. It thus appears that the ridge estimators proposed to date are not a viable alternative to OLS. However, the results show that it might be possible to define a ridge estimator that would be better than OLS. Until the properties of such an estimator are rigorously derived, the authors caution against using ridge analysis to estimate regression coefficients. (Author).

Theory of Ridge Regression Estimation with Applications

Theory of Ridge Regression Estimation with Applications
Author: A. K. Md. Ehsanes Saleh
Publisher: John Wiley & Sons
Total Pages: 384
Release: 2019-01-08
Genre: Mathematics
ISBN: 1118644522

Download Theory of Ridge Regression Estimation with Applications Book in PDF, Epub and Kindle

A guide to the systematic analytical results for ridge, LASSO, preliminary test, and Stein-type estimators with applications Theory of Ridge Regression Estimation with Applications offers a comprehensive guide to the theory and methods of estimation. Ridge regression and LASSO are at the center of all penalty estimators in a range of standard models that are used in many applied statistical analyses. Written by noted experts in the field, the book contains a thorough introduction to penalty and shrinkage estimation and explores the role that ridge, LASSO, and logistic regression play in the computer intensive area of neural network and big data analysis. Designed to be accessible, the book presents detailed coverage of the basic terminology related to various models such as the location and simple linear models, normal and rank theory-based ridge, LASSO, preliminary test and Stein-type estimators. The authors also include problem sets to enhance learning. This book is a volume in the Wiley Series in Probability and Statistics series that provides essential and invaluable reading for all statisticians. This important resource: Offers theoretical coverage and computer-intensive applications of the procedures presented Contains solutions and alternate methods for prediction accuracy and selecting model procedures Presents the first book to focus on ridge regression and unifies past research with current methodology Uses R throughout the text and includes a companion website containing convenient data sets Written for graduate students, practitioners, and researchers in various fields of science, Theory of Ridge Regression Estimation with Applications is an authoritative guide to the theory and methodology of statistical estimation.

Parameter Estimation in Engineering and Science

Parameter Estimation in Engineering and Science
Author: James Vere Beck
Publisher: James Beck
Total Pages: 540
Release: 1977
Genre: Mathematics
ISBN: 9780471061182

Download Parameter Estimation in Engineering and Science Book in PDF, Epub and Kindle

Introduction to and survey of parameter estimation; Probability; Introduction to statistics; Parameter estimation methods; Introduction to linear estimation; Matrix analysis for linear parameter estimation; Minimization of sum of squares functions for models nonlinear in parameters; Design of optimal experiments.