Caltech Computer Science Technical Reports

Perceptron learning with random coordinate descent

Li, Ling (2005) Perceptron learning with random coordinate descent. Technical Report. California Institute of Technology, Pasadena, USA. [CaltechCSTR:2005.006]

Full text available as:

PDF - Requires Adobe Acrobat Reader or other PDF viewer.
Postscript - Requires a viewer, such as GhostView

Abstract

A perceptron is a linear threshold classifier that separates examples with a hyperplane. It is perhaps the simplest learning model that is used standalone. In this paper, we propose a family of random coordinate descent algorithms for perceptron learning on binary classification problems. Unlike most perceptron learning algorithms which require smooth cost functions, our algorithms directly minimize the training error, and usually achieve the lowest training error compared with other algorithms. The algorithms are also computational efficient. Such advantages make them favorable for both standalone use and ensemble learning, on problems that are not linearly separable. Experiments show that our algorithms work very well with AdaBoost, and achieve the lowest test errors for half of the datasets.

EPrint Type:Monograph (Technical Report)
Additional Information:For C++ code of the perceptron learning algorithms used in this paper, please see http://www.work.caltech.edu/ling/lemga/ ; For the artificial datasets used in this paper, please see http://www.work.caltech.edu/ling/data/ .
Subjects:All Records
ID Code:548
Deposited By:Ling Li
Deposited On:31 August 2005
Record Number:CaltechCSTR:2005.006
Official Persistent URL:http://resolver.caltech.edu/CaltechCSTR:2005.006
Official Citation:L. Li. Perceptron learning with random coordinate descent. Computer Science Technical Report CaltechCSTR:2005.006, California Institute of Technology, Aug. 2005.
Usage Policy:You are granted permission for individual, educational, research and non-commercial reproduction, distribution, display and performance of this work in any format.

Archive Staff Only: edit this record