Diagnostic Prediction Using Discomfort Drawings with IBTM

Cheng Zhang, Hedvig Kjellström, Carl Henrik Ek, Bo C. Bertilson

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

48 Downloads (Pure)


In this paper, we explore the possibility to apply machine learning to make diagnostic predictions using discomfort drawings. A discomfort drawing is an intuitive way for patients to express discomfort and pain related symptoms. These drawings have proven to be an effective method to collect patient data and make diagnostic decisions in real-life practice. A dataset from real-world patient cases is collected for which medical experts provide diagnostic labels. Next, we use a factorized multimodal topic model, Inter-Battery Topic Model (IBTM), to train a system that can make diagnostic predictions given an unseen discomfort drawing. The number of output diagnostic labels is determined by using mean-shift clustering on the discomfort drawing. Experimental results show reasonable predictions of diagnostic labels given an unseen discomfort drawing. Additionally, we generate synthetic discomfort drawings with IBTM given a diagnostic label, which results in typical cases of symptoms. The positive result indicates a significant potential of machine learning to be used for parts of the pain diagnostic process and to be a decision support system for physicians and other health care personnel.
Original languageEnglish
Title of host publicationProceedings of the 1st Machine Learning in Health Care, MLHC 2016, Los Angeles, CA, USA, August 19-20, 2016
EditorsFinale Doshi-Velez, Jim Fackler, David C. Kale, Byron C. Wallace, Jenna Wiens
Number of pages13
Publication statusPublished - 27 Jul 2016

Publication series

NameJMLR Workshop and Conference Proceedings


Dive into the research topics of 'Diagnostic Prediction Using Discomfort Drawings with IBTM'. Together they form a unique fingerprint.

Cite this