Model Browser User's Guide    

GCV for Ridge Regression

It is shown in Orr (4), and stated in Orr (5, see References) that for the case of ridge regression GCV can be written as

where is the "effective number of parameters" that is given by

The formula for updating is given by

In practice, the preceding formulas are not used explicitly in Orr (5, see References). Instead a singular value decomposition of X is made, and the formulas are rewritten in terms of the eigenvalues and eigenvectors of the matrix XX'. This avoids taking the inverse of the matrix A, and it can be used to cheaply compute GCV for many values of .


  GCV Criterion GCV for Rols