Emotions in annotation

Teodor  Stoev; Kristina Yordanova; Emma L. Tonkin

Emotions in annotation

Teodor Stoev, Kristina Yordanova, Emma L. Tonkin

Research output: Contribution to conference › Conference Paper › peer-review

Abstract

In this paper we present different aspects of how emotions can relate to the problem of data annotation. Our main contribution is an extensive literature review where we discuss how emotions could influence different stages of annotation tasks. The results of our literature review show that the nature of the data itself might be crucial to how the emotional state of annotators is affected, but also that the process is affected by other factors such as initial motivation, time pressure, repetitiveness, emotional reaction to particular words\slash scenes, and demographic background of annotators. In addition to the literature review we formulate several hypotheses connected with the effects of emotions on the overall annotation process and propose an experiment with the help of which these hypotheses could be studied.

Original language	English
Publication status	Published - 17 Mar 2023
Event	ARDUOUS 2023: Workshop at PerCom 2023 - Atlanta, Georgia, United States Duration: 13 Mar 2023 → 17 Mar 2023 https://text2hbm.org/arduous/

Workshop

Workshop	ARDUOUS 2023
Abbreviated title	ARDUOUS 2023
Country/Territory	United States
City	Atlanta, Georgia
Period	13/03/23 → 17/03/23
Internet address	https://text2hbm.org/arduous/

Keywords

data annotation
data labeling
emotion
stress

Handle.net

Persistent link

SPHERE2
Craddock, I. J. (Principal Investigator), Mirmehdi, M. (Co-Investigator), Piechocki, R. J. (Co-Investigator), Flach, P. A. (Co-Investigator), Oikonomou, G. (Co-Investigator), Burghardt, T. (Co-Investigator), Damen, D. (Co-Investigator), Santos-Rodriguez, R. (Co-Investigator), O'Kane, A. A. (Co-Investigator), McConville, R. (Co-Investigator), Masullo, A. (Co-Investigator) & Gooberman-Hill, R. (Co-Investigator)
1/10/18 → 31/01/23
Project: Research, Parent

Mare Balticum Research Fellowship, Rostock
Tonkin, E. L. (Recipient), May 2022
Prize: Prizes, Medals, Awards and Grants

File

Cite this

@conference{44431c1f9c574b82907287b7efe3ba63,

title = "Emotions in annotation",

abstract = "In this paper we present different aspects of how emotions can relate to the problem of data annotation. Our main contribution is an extensive literature review where we discuss how emotions could influence different stages of annotation tasks. The results of our literature review show that the nature of the data itself might be crucial to how the emotional state of annotators is affected, but also that the process is affected by other factors such as initial motivation, time pressure, repetitiveness, emotional reaction to particular words\textbackslash{}slash scenes, and demographic background of annotators. In addition to the literature review we formulate several hypotheses connected with the effects of emotions on the overall annotation process and propose an experiment with the help of which these hypotheses could be studied.",

keywords = "data annotation, data labeling, emotion, stress",

author = "Teodor Stoev and Kristina Yordanova and Tonkin, \{Emma L.\}",

year = "2023",

month = mar,

day = "17",

language = "English",

note = "ARDUOUS 2023 : Workshop at PerCom 2023, ARDUOUS 2023 ; Conference date: 13-03-2023 Through 17-03-2023",

url = "https://text2hbm.org/arduous/",

}

TY - CONF

T1 - Emotions in annotation

AU - Stoev, Teodor

AU - Yordanova, Kristina

AU - Tonkin, Emma L.

PY - 2023/3/17

Y1 - 2023/3/17

N2 - In this paper we present different aspects of how emotions can relate to the problem of data annotation. Our main contribution is an extensive literature review where we discuss how emotions could influence different stages of annotation tasks. The results of our literature review show that the nature of the data itself might be crucial to how the emotional state of annotators is affected, but also that the process is affected by other factors such as initial motivation, time pressure, repetitiveness, emotional reaction to particular words\slash scenes, and demographic background of annotators. In addition to the literature review we formulate several hypotheses connected with the effects of emotions on the overall annotation process and propose an experiment with the help of which these hypotheses could be studied.

AB - In this paper we present different aspects of how emotions can relate to the problem of data annotation. Our main contribution is an extensive literature review where we discuss how emotions could influence different stages of annotation tasks. The results of our literature review show that the nature of the data itself might be crucial to how the emotional state of annotators is affected, but also that the process is affected by other factors such as initial motivation, time pressure, repetitiveness, emotional reaction to particular words\slash scenes, and demographic background of annotators. In addition to the literature review we formulate several hypotheses connected with the effects of emotions on the overall annotation process and propose an experiment with the help of which these hypotheses could be studied.

KW - data annotation

KW - data labeling

KW - emotion

KW - stress

M3 - Conference Paper

T2 - ARDUOUS 2023

Y2 - 13 March 2023 through 17 March 2023

ER -

Emotions in annotation

Abstract

Workshop

Keywords

Handle.net

Fingerprint

Projects

SPHERE2

Prizes

Mare Balticum Research Fellowship, Rostock

Cite this