Efficient learning beyond saturation by single-layered neural networks

S Coombes, C Campbell

Research output: Working paperWorking paper and Preprints

84 Downloads (Pure)

Abstract

We present two distinct learning rules that can be applied to the problem of constructing a dichotomy of an arbitrary pattern set. Both rules are given in a closed form and are discussed, within the context of a single layered network of N nodes storing P patterns. For P less than or equal to N both rules realize dichotomies of a pattern set and can quarantee perfect storage up to a maximal capacity of P=N. Beyond this maximal capacity the rules can be used to give efficient solutions with a small number of errors. Their efficiency for learning beyond saturation and the simple closed form of these solutions make them ideal for use in constructive algorithms. Generalization performance and the issue of pattern stability in the regime of perfect storage are also examined and theoretical predictions are compared with simulations
Original languageEnglish
Publication statusUnpublished - 1996

Keywords

  • dichotomy of an arbitrary pattern set
  • perfect storage
  • single layered neural network
  • closed form solutions

Fingerprint Dive into the research topics of 'Efficient learning beyond saturation by single-layered neural networks'. Together they form a unique fingerprint.

Cite this