Recruiting Participants With Programming Skills: A Comparison of Four Crowdsourcing Platforms and a CS Student Mailing List

Mohammad Tahaei, Kami Vaniea

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

31 Citations (Scopus)
59 Downloads (Pure)

Abstract

Reliably recruiting participants with programming skills is an ongoing challenge for empirical studies involving software development technologies, often leading to the use of crowdsourcing platforms and computer science (CS) students. In this work, we use five existing survey instruments to explore the programming skills, privacy and security attitudes, and secure development self-efficacy of participants from a CS student mailing list and four crowdsourcing platforms (Appen, Clickworker, MTurk, and Prolific). We recruited 613 participants who claimed to have programming skills and assessed recruitment channels regarding costs, quality, programming skills, as well as privacy and security attitudes.
Original languageEnglish
Title of host publicationCHI 2022 - Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
Subtitle of host publication CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery (ACM)
Pages1-15
ISBN (Electronic)9781450391573
ISBN (Print)9781450391573
DOIs
Publication statusPublished - 29 Apr 2022

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Bibliographical note

Funding Information:
We thank Chris Lucas for extensive advice on statistics and the reviewers whose constructive feedback helped improve the paper. Mohammad did this work while he was at the University of Edinburgh. This work was sponsored in part by Microsoft Research through its Ph.D. Scholarship Program as well as the University of Edinburgh’s Institute for Language, Cognition and Computation.

Publisher Copyright:
© 2022 ACM.

Fingerprint

Dive into the research topics of 'Recruiting Participants With Programming Skills: A Comparison of Four Crowdsourcing Platforms and a CS Student Mailing List'. Together they form a unique fingerprint.

Cite this