Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determination

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

19 Citations (Scopus)
218 Downloads (Pure)

Abstract

This paper presents a method for assessing skill from video, applicable to a variety of tasks, ranging from surgery to drawing and rolling pizza dough. We formulate the problem as pairwise (who’s better?) and overall (who’s best?) ranking of video collections, using supervised deep ranking. We propose a novel loss function that learns discriminative features when a pair of videos exhibit variance in skill, and learns shared features when a pair of videos exhibit comparable skill levels. Results demonstrate our method is applicable across tasks, with the percentage of correctly ordered pairs of videos ranging from 70% to 83% for four datasets. We demonstrate the robustness of our approach via sensitivity analysis of its parameters. We see this work as effort toward the automated organization of how-to video collections and overall, generic skill determination in video.
Original languageEnglish
Title of host publication2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2018)
Subtitle of host publicationProceedings of a meeting held 18-22 June 2018, Salt Lake City, Utah, USA
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages6057-6066
Number of pages10
ISBN (Electronic)9781538664209
ISBN (Print)9781538664216
DOIs
Publication statusPublished - Feb 2019
EventComputer Vision and Pattern Recognition - Salt Lake City, United States
Duration: 18 Jun 201822 Jun 2018

Publication series

Name
ISSN (Print)1063-6919
ISSN (Electronic)2575-7075

Conference

ConferenceComputer Vision and Pattern Recognition
Abbreviated titleCVPR
CountryUnited States
CitySalt Lake City
Period18/06/1822/06/18

Fingerprint Dive into the research topics of 'Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determination'. Together they form a unique fingerprint.

  • Projects

    Cite this

    Doughty, H., Damen, D., & Mayol-Cuevas, W. (2019). Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determination. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2018): Proceedings of a meeting held 18-22 June 2018, Salt Lake City, Utah, USA (pp. 6057-6066). [8578732] Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/CVPR.2018.00634