On the Need for Structure Modelling in Sequence Prediction

Niall Twomey, Tom Diethe, Peter Flach

Research output: Contribution to journalArticle (Academic Journal)

2 Citations (Scopus)
434 Downloads (Pure)

Abstract

There is no uniform approach in the literature for modelling sequential correlations in sequence classification problems. It is easy to find examples of unstructured models (e.g. logistic regression) where correlations are not taken into account at all, but there are also many examples where the correlations are explicitly incorporated into a – potentially computationally expensive – structured classification model (e.g. conditional random fields). In this paper we lay theoretical and empirical foundations for clarifying the types of problem which necessitate direct modelling of correlations in sequences, and the types of problem where unstructured models that capture sequential aspects solely through features are sufficient. The theoretical work in this paper shows that the rate of decay of auto-correlations within a sequence is related to the excess classification risk that is incurred by ignoring the structural aspect of the data. This is an intuitively appealing result, demonstrating the intimate link between the auto-correlations and excess classification risk. Drawing directly on this theory, we develop well-founded visual analytics tools that can be applied a priori on data sequences and we demonstrate how these tools can guide practitioners in specifying feature representations based on auto-correlation profiles. Empirical analysis is performed on three sequential datasets. With baseline feature templates, structured and unstructured models achieve similar performance, indicating no initial preference for either model. We then apply the visual analytics tools to the datasets, and show that classification performance in all cases is improved over baseline results when our tools are involved in defining feature representations.
Original languageEnglish
Pages (from-to)291–314
Number of pages24
JournalMachine Learning
Volume104
Issue number2
Early online date21 Jul 2016
DOIs
Publication statusPublished - Sep 2016

Structured keywords

  • Jean Golding

Keywords

  • structure modelling
  • conditional random field
  • autocorrelation

Fingerprint Dive into the research topics of 'On the Need for Structure Modelling in Sequence Prediction'. Together they form a unique fingerprint.

  • Projects

    SPHERE (EPSRC IRC)

    Craddock, I. J., Coyle, D. T., Flach, P. A., Kaleshi, D., Mirmehdi, M., Piechocki, R. J., Stark, B. H., Ascione, R., Ashburn, A. M., Burnett, M. E., Aldamen, D., Gooberman-Hill, R. J. S., Harwin, W. S., Hilton, G., Holderbaum, W., Holley, A. P., Manchester, V. A., Meller, B. J., Stack, E. & Gilchrist, I. D.

    1/10/1330/09/18

    Project: Research, Parent

    Cite this