http://en.wikipedia.org/wiki/Tikhonov_regularization
Called ridge regression in statistics.

Regularization: Ridge Regression and the LASSO is another good reference. In R, use lm.ridge().

Here’s sample code that describes not just lm.ridge, but also pls(partial least square), lasso, and pcr(principal component regression).