Skip to content

Calorie counter: RGB-depth visual estimation of energy expenditure at home

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Original languageEnglish
Title of host publicationComputer Vision - ACCV 2016 Workshops
Subtitle of host publicationACCV 2016 International Workshops, Revised Selected Papers
Publisher or commissioning bodySpringer-Verlag Berlin
Number of pages13
ISBN (Print)9783319544069
DateAccepted/In press - 18 Sep 2016
DatePublished (current) - 15 Mar 2017
Event13th Asian Conference on Computer Vision 2016: Workshop on Assistive Vision - Taipei International Convention Center, Taipei, Taiwan
Duration: 20 Nov 201624 Nov 2016
Conference number: 13

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10116 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349


Conference13th Asian Conference on Computer Vision 2016
Abbreviated titleACCV 16
Internet address


We present a new framework for vision-based estimation of calorific expenditure from RGB-D data - the first that is validated on physical gas exchange measurements and applied to daily living scenarios. Deriving a person’s energy expenditure from sensors is an important tool in tracking physical activity levels for health and lifestyle monitoring. Most existing methods use metabolic lookup tables (METs) for a manual estimate or systems with inertial sensors which ultimately require users to wear devices. In contrast, the proposed pose-invariant and individual-independent vision framework allows for a remote estimation of calorific expenditure. We introduce, and evaluate our approach on, a new dataset called SPHERE-calorie, for which visual estimates can be compared against simultaneously obtained, indirect calorimetry measures based on gas exchange. We conclude from our experiments that the proposed vision pipeline is suitable for home monitoring in a controlled environment, with calorific expenditure estimates above accuracy levels of commonly used manual estimations via METs. With the dataset released, our work establishes a baseline for future research for this little-explored area of computer vision.

    Structured keywords

  • Digital Health

    Research areas

  • Digital Health


13th Asian Conference on Computer Vision 2016: Workshop on Assistive Vision

Abbreviated titleACCV 16
Conference number13
Duration20 Nov 201624 Nov 2016
Location of eventTaipei International Convention Center
Web address (URL)

Event: Conference

Download statistics

No data available



  • Full-text PDF (accepted author manuscript)

    Rights statement: This is the author accepted manuscript (AAM). The final published version (version of record) is available online via SpringerLink at . Please refer to any applicable terms of use of the publisher.

    Accepted author manuscript, 1 MB, PDF document


View research connections

Related faculties, schools or groups