Caltech Computer Science Technical Reports

No Free Lunch for Early Stopping

Cataltepe, Zehra and Abu-Mostafa, Yaser S. and Magdon-Ismail, Malik (1998) No Free Lunch for Early Stopping. Technical Report. California Institute of Technology. [CaltechCSTR:1998.cs-tr-98-02]

Full text available as:

Postscript - Requires a viewer, such as GhostView
Other (Adobe PDF (196KB))

Abstract

We show that, with a uniform prior on hypothesis functions having the same training error, early stopping at some fixed training error above the training error minimum results in an increase in the expected generalization error. We also show that regularization methods are equivalent to early stopping with certain non-uniform prior on the early stopping solutions.

EPrint Type:Monograph (Technical Report)
Subjects:All Records
ID Code:186
Deposited By:Caltech Library System
Deposited On:30 April 2001
Record Number:CaltechCSTR:1998.cs-tr-98-02
Official Persistent URL:http://resolver.caltech.edu/CaltechCSTR:1998.cs-tr-98-02
Usage Policy:You are granted permission for individual, educational, research and non-commercial reproduction, distribution, display and performance of this work in any format.

Archive Staff Only: edit this record