Skip to main navigation Skip to search Skip to main content

Recruiting Participants With Programming Skills: A Comparison of Four Crowdsourcing Platforms and a CS Student Mailing List

  • Mohammad Tahaei
  • , Kami Vaniea

    Research output: Chapter in Book/Report/Conference proceeding › Conference Contribution (Conference Proceeding)

    55 Citations (Scopus)
    204 Downloads (Pure)

    Abstract

    Reliably recruiting participants with programming skills is an ongoing challenge for empirical studies involving software development technologies, often leading to the use of crowdsourcing platforms and computer science (CS) students. In this work, we use five existing survey instruments to explore the programming skills, privacy and security attitudes, and secure development self-efficacy of participants from a CS student mailing list and four crowdsourcing platforms (Appen, Clickworker, MTurk, and Prolific). We recruited 613 participants who claimed to have programming skills and assessed recruitment channels regarding costs, quality, programming skills, as well as privacy and security attitudes.
    Original languageEnglish
    Title of host publicationCHI 2022 - Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
    Subtitle of host publication CHI Conference on Human Factors in Computing Systems
    PublisherAssociation for Computing Machinery
    Pages1-15
    ISBN (Electronic)9781450391573
    ISBN (Print)9781450391573
    DOIs
    Publication statusPublished - 29 Apr 2022

    Publication series

    NameConference on Human Factors in Computing Systems - Proceedings

    Bibliographical note

    Funding Information:
    We thank Chris Lucas for extensive advice on statistics and the reviewers whose constructive feedback helped improve the paper. Mohammad did this work while he was at the University of Edinburgh. This work was sponsored in part by Microsoft Research through its Ph.D. Scholarship Program as well as the University of Edinburgh’s Institute for Language, Cognition and Computation.

    Publisher Copyright:
    © 2022 ACM.

    Fingerprint

    Dive into the research topics of 'Recruiting Participants With Programming Skills: A Comparison of Four Crowdsourcing Platforms and a CS Student Mailing List'. Together they form a unique fingerprint.

    Cite this