Skip to content

Energy expenditure estimation using visual and inertial sensors

Research output: Contribution to journalArticle

Original languageEnglish
Pages (from-to)36-47
Number of pages12
JournalIET Computer VIsion
Issue number1
Early online date31 Jan 2018
DateAccepted/In press - 1 Sep 2017
DateE-pub ahead of print - 31 Jan 2018
DatePublished (current) - 1 Feb 2018


Deriving a person's energy expenditure accurately forms the foundation for tracking physical activity levels across many health and lifestyle monitoring tasks. In this study, the authors present a method for estimating calorific expenditure from combined visual and accelerometer sensors by way of an RGB-Depth camera and a wearable inertial sensor. The proposed individual-independent framework fuses information from both modalities which leads to improved estimates beyond the accuracy of single modality and manual metabolic equivalents of task (MET) lookup table based methods. For evaluation, the authors introduce a new dataset called SPHERE_RGBD + Inertial_calorie, for which visual and inertial data are simultaneously obtained with indirect calorimetry ground truth measurements based on gas exchange. Experiments show that the fusion of visual and inertial data reduces the estimation error by 8 and 18% compared with the use of visual only and inertial sensor only, respectively, and by 33% compared with a MET-based approach. The authors conclude from their results that the proposed approach is suitable for home monitoring in a controlled environment.

    Structured keywords

  • Digital Health

    Research areas

  • Digital Health

Download statistics

No data available



  • Full-text PDF (final published version)

    Rights statement: This is the final published version of the article (version of record). It first appeared online via IET at . Please refer to any applicable terms of use of the publisher.

    Final published version, 6 MB, PDF document

    Licence: CC BY


View research connections

Related faculties, schools or groups