A Comparative Evaluation of Feature Set Evolution Strategies for Multirelational Boosting

S Hoche, S Wrobel

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

Abstract

Boosting has established itself as a successful technique for decreasing the generalization error of classification learners by basing predictions on ensembles of hypotheses. While previous research has shown that this technique can be made to work efficiently even in the context of multirelational learning by using simple learners and active feature selection, such approaches have relied on simple and static methods of determining feature selection ordering a priori and adding features only in a forward manner. In this paper, we investigate whether the distributional information present in boosting can usefully be exploited in the course of learning to reweight features and in fact even to dynamically adapt the feature set by adding the currently most relevant features and removing those that are no longer needed. Preliminary results show that these more informed feature set evolution strategies surprisingly have mixed effects on the number of features ultimately used in the ensemble, and on the resulting classification accuracy.
Translated title of the contributionA Comparative Evaluation of Feature Set Evolution Strategies for Multirelational Boosting
Original languageEnglish
Title of host publicationUnknown
PublisherSpringer
Pages180 - 196
Number of pages16
ISBN (Print)3540201440
Publication statusPublished - Oct 2003

Bibliographical note

Conference Proceedings/Title of Journal: Proceedings of the 13th International Conference on Inductive Logic Programming, LNCS 2835

Fingerprint Dive into the research topics of 'A Comparative Evaluation of Feature Set Evolution Strategies for Multirelational Boosting'. Together they form a unique fingerprint.

Cite this