Ridge Regression

• LinearRegression
• $(X{X}^{\prime })$ suffers from numerical instability when almost singular (real world data. sparse I think)
• Add a tiny term
  • $w_{opt}^{\prime }=(X{X}^{\prime }+{\alpha }^2{I}_{nxn}{)}^{-1}XY$
  • Solution to overfitting