Collecting Food and Drink Intake Data With Voice Input: Development, Usability, and Acceptability Study

Louise A C Millard*, Laura Johnson, Samuel Neaves, Peter A Flach, Kate M Tilling, Debbie A Lawlor

*Corresponding author for this work

Research output: Contribution to journalArticle (Academic Journal)peer-review

1 Citation (Scopus)

Abstract

Background: Voice-based systems such as Amazon Alexa may be useful for collecting self-reported information in real time from participants of epidemiology studies using verbal input. In epidemiological research studies, self-reported data tend to be collected using short, infrequent questionnaires, in which the items require participants to select from predefined options, which may lead to errors in the information collected and lack of coverage. Voice-based systems give the potential to collect self-reported information “continuously” over several days or weeks. At present, to the best of our knowledge, voice-based systems have not been used or evaluated for collecting epidemiological data.

Objective: We aimed to demonstrate the technical feasibility of using Alexa to collect information from participants, investigate participant acceptability, and provide an initial evaluation of the validity of the collected data. We used food and drink information as an exemplar.

Methods: We recruited 45 staff members and students at the University of Bristol (United Kingdom). Participants were asked to tell Alexa what they ate or drank for 7 days and to also submit this information using a web-based form. Questionnaires asked for basic demographic information, about their experience during the study, and the acceptability of using Alexa.

Results: Of the 37 participants with valid data, most (n=30, 81%) were aged 20 to 39 years and 23 (62%) were female. Across 29 participants with Alexa and web entries corresponding to the same intake event, 60.1% (357/588) of Alexa entries contained the same food and drink information as the corresponding web entry. Most participants reported that Alexa interjected, and this was worse when entering the food and drink information (17/35, 49% of participants said this happened often; 1/35, 3% said this happened always) than when entering the event date and time (6/35, 17% of participants said this happened often; 1/35, 3% said this happened always). Most (28/35, 80%) said they would be happy to use a voice-controlled system for future research.

Conclusions: Although there were some issues interacting with the Alexa skill, largely because of its conversational nature and because Alexa interjected if there was a pause in speech, participants were mostly willing to participate in future research studies using Alexa. More studies are needed, especially to trial less conversational interfaces.
Original languageEnglish
Article numbere41117
JournalJMIR mHealth and uHealth
Volume11
DOIs
Publication statusPublished - 31 Mar 2023

Bibliographical note

Funding Information:
This work was supported by the University of Bristol and the UK Medical Research Council (grants MC_UU_00011/3 and MC_UU_00011/6). LACM received funding from a University of Bristol Vice-Chancellor’s Fellowship. This study was also supported by the National Institute for Health and Care Research Biomedical Research Centre at the University Hospitals Bristol National Health Service Foundation Trust and the University of Bristol (specifically via a Biomedical Research Centre Directors Fund grant). DAL’s contribution is supported by the British Heart Foundation (grants CH/F/20/90003 and AA/18/7/34219).

Funding Information:
DAL has received support from numerous national and international governments and charitable funders as well as Roche Diagnostics and Medtronic Ltd for work unrelated to this paper. KT received grant support including from the UK Government and US Government for research unrelated to this work.

Publisher Copyright:
© 2023 JMIR Publications. All rights reserved.

Fingerprint

Dive into the research topics of 'Collecting Food and Drink Intake Data With Voice Input: Development, Usability, and Acceptability Study'. Together they form a unique fingerprint.

Cite this