An empirical study of greedy kernel fisher discriminants

Tom Diethe*

*Corresponding author for this work

Research output: Contribution to journalArticle (Academic Journal)peer-review

275 Downloads (Pure)


A sparse version of Kernel Fisher Discriminant Analysis using an approach based on Matching Pursuit (MPKFDA) has been shown to be competitive with Kernel Fisher Discriminant Analysis and the Support Vector Machines on publicly available datasets, with additional experiments showing that MPKFDA on average outperforms these algorithms in extremely high dimensional settings. In (nearly) all cases, the resulting classifier was sparser than the Support Vector Machine. Natural questions that arise are what is the relative importance of the use of the Fisher criterion for selecting bases and the deflation step? Can we speed the algorithm up without degrading performance? Here we analyse the algorithm in more detail, providing alternatives to the optimisation criterion and the deflation procedure of the algorithm, and also propose a stagewise version. We demonstrate empirically that these alternatives can provide considerable improvements in the computational complexity, whilst maintaining the performance of the original algorithm (and in some cases improving it).

Original languageEnglish
Article number793986
Number of pages12
JournalMathematical Problems in Engineering
Publication statusPublished - 2015

Structured keywords

  • Digital Health

Fingerprint Dive into the research topics of 'An empirical study of greedy kernel fisher discriminants'. Together they form a unique fingerprint.

Cite this