37 Downloads (Pure)

Abstract

We propose a novel deep fusion architecture, CaloriNet, for the online estimation of energy expenditure for free living monitoring in private environments, where RGB data is discarded and replaced by silhouettes. Our fused convolutional neural network architecture is trainable end-to-end, to estimate calorie expenditure, using temporal foreground silhouettes alongside accelerometer data. The network is trained and cross-validated on a publicly available dataset, SPHERE_RGBD + Inertial_calorie. Results show state-of-the-art minimum error on the estimation of energy expenditure (calories per minute), outperforming alternative, standard and single-modal techniques.
Original languageEnglish
Number of pages14
Publication statusPublished - 20 Jul 2018
Event29th British Machine Vision Conference - Northumbria University, Newcastle upon Tyne, United Kingdom
Duration: 3 Sep 20186 Sep 2018
http://bmvc2018.org/index.html

Conference

Conference29th British Machine Vision Conference
CountryUnited Kingdom
CityNewcastle upon Tyne
Period3/09/186/09/18
Internet address

Structured keywords

  • Digital Health

Fingerprint Dive into the research topics of 'CaloriNet: From silhouettes to calorie estimation in private environments'. Together they form a unique fingerprint.

  • Projects

    SPHERE (EPSRC IRC)

    Craddock, I. J., Coyle, D. T., Flach, P. A., Kaleshi, D., Mirmehdi, M., Piechocki, R. J., Stark, B. H., Ascione, R., Ashburn, A. M., Burnett, M. E., Aldamen, D., Gooberman-Hill, R. J. S., Harwin, W. S., Hilton, G., Holderbaum, W., Holley, A. P., Manchester, V. A., Meller, B. J., Stack, E. & Gilchrist, I. D.

    1/10/1330/09/18

    Project: Research, Parent

    Cite this

    Masullo, A., Burghardt, T., Damen, D., Hannuna, S., Ponce Lopez, V., & Mirmehdi, M. (2018). CaloriNet: From silhouettes to calorie estimation in private environments. Paper presented at 29th British Machine Vision Conference, Newcastle upon Tyne, United Kingdom. http://bmvc2018.org/programmedetail.html