Ethics of Trust/worthiness in Autonomous Systems: a scoping review

Helen Smith; Arianna Manzini; Mari-Rose Kennedy; Jonathan C S Ives

doi:10.1145/3597512.3600207

Ethics of Trust/worthiness in Autonomous Systems: a scoping review

Helen Smith^*, Arianna Manzini, Mari-Rose Kennedy, Jonathan C S Ives

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference Contribution (Conference Proceeding)

5 Citations (Scopus)

Abstract

The development of adaptive autonomous systems with evolving functionality (AASEFs) differs from their technological predecessors due to their changing, rather than static, architectures and processes; subsequently, their development, deployment, and implementation creates novel ethical issues. Our scoping review surveys the literature to identify the problematic nature of AASEFs, the ethical worries that they generate, and the ethical principles affected. Our literature examination also ascertains stakeholder needs and solutions regarding the trust and trustworthiness of ASSEFs.
The characteristics of non-explicability and fluctuating behaviour are predominantly problematic of AASEFs. The literature advocates for AASEF development incorporating ‘ethics by design’ with enforceable standards supported via regulatory and legal structures.

Original language	English
Title of host publication	TAS 2023 - Proceedings of the 1st International Symposium on Trustworthy Autonomous Systems
Publisher	Association for Computing Machinery (ACM)
Pages	1-15
ISBN (Electronic)	9798400707346
DOIs	https://doi.org/10.1145/3597512.3600207
Publication status	Published - 11 Jul 2023
Event	First International Symposium on Trustworthy Autonomous Systems (TAS'23) - Heriot-Watt University in Edinburgh, Edinburgh, United Kingdom Duration: 11 Jul 2023 → 12 Jul 2023 https://symposium.tas.ac.uk/

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	First International Symposium on Trustworthy Autonomous Systems (TAS'23)
Country/Territory	United Kingdom
City	Edinburgh
Period	11/07/23 → 12/07/23
Internet address	https://symposium.tas.ac.uk/

Bibliographical note

Funding Information:
The UKRI’s Trustworthy Autonomous Systems Node in Functionality (grant number EP/V026518/1) funded HS, AM, and JI to produce this review.

Funding Information:
JI is in part supported by the NIHR Biomedical Research Centre at University Hospitals Bristol and Weston NHS Foundation Trust and the University of Bristol. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health and Social Care.

Funding Information:
MRK was funded by emPOWER (EPSRC - EP/T020792/1) when contributing to this work, and is now funded by the NIHR ARC West.

Funding Information:
HS is additionally supported by the Elizabeth Blackwell Institute, University of Bristol via the Wellcome Trust Institutional Strategic Support Fund.

Publisher Copyright:
© 2023 Owner/Author.

Keywords

Ethics
Autonomous Systems
AI
Robotics
Trust
Trustworthiness
Literature Review

Access to Document

10.1145/3597512.3600207Licence: CC BY

Handle.net

Persistent link

UKRI Trustworthy Autonomous Systems Node In Functionality
Windsor, S. P. (Principal Investigator), Ives, J. C. S. (Co-Investigator), Downer, J. R. (Co-Investigator), Rossiter, J. M. (Co-Investigator), Eder, K. I. (Co-Investigator) & Hauert, S. (Co-Investigator)
1/11/20 → 30/04/24
Project: Research, Parent

Cite this

Smith, H., Manzini, A., Kennedy, M.-R., & Ives, J. C. S. (2023). Ethics of Trust/worthiness in Autonomous Systems: a scoping review. In TAS 2023 - Proceedings of the 1st International Symposium on Trustworthy Autonomous Systems (pp. 1-15). Article 20 (ACM International Conference Proceeding Series). Association for Computing Machinery (ACM). https://doi.org/10.1145/3597512.3600207

@inproceedings{9e72155249614e6982b5f518fb65f505,

title = "Ethics of Trust/worthiness in Autonomous Systems: a scoping review",

abstract = "The development of adaptive autonomous systems with evolving functionality (AASEFs) differs from their technological predecessors due to their changing, rather than static, architectures and processes; subsequently, their development, deployment, and implementation creates novel ethical issues. Our scoping review surveys the literature to identify the problematic nature of AASEFs, the ethical worries that they generate, and the ethical principles affected. Our literature examination also ascertains stakeholder needs and solutions regarding the trust and trustworthiness of ASSEFs.The characteristics of non-explicability and fluctuating behaviour are predominantly problematic of AASEFs. The literature advocates for AASEF development incorporating {\textquoteleft}ethics by design{\textquoteright} with enforceable standards supported via regulatory and legal structures.",

keywords = "Ethics, Autonomous Systems, AI, Robotics, Trust, Trustworthiness, Literature Review",

author = "Helen Smith and Arianna Manzini and Mari-Rose Kennedy and Ives, {Jonathan C S}",

note = "Funding Information: The UKRI{\textquoteright}s Trustworthy Autonomous Systems Node in Functionality (grant number EP/V026518/1) funded HS, AM, and JI to produce this review. Funding Information: JI is in part supported by the NIHR Biomedical Research Centre at University Hospitals Bristol and Weston NHS Foundation Trust and the University of Bristol. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health and Social Care. Funding Information: MRK was funded by emPOWER (EPSRC - EP/T020792/1) when contributing to this work, and is now funded by the NIHR ARC West. Funding Information: HS is additionally supported by the Elizabeth Blackwell Institute, University of Bristol via the Wellcome Trust Institutional Strategic Support Fund. Publisher Copyright: {\textcopyright} 2023 Owner/Author.; First International Symposium on Trustworthy Autonomous<br/>Systems (TAS'23) ; Conference date: 11-07-2023 Through 12-07-2023",

year = "2023",

month = jul,

day = "11",

doi = "10.1145/3597512.3600207",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery (ACM)",

pages = "1--15",

booktitle = "TAS 2023 - Proceedings of the 1st International Symposium on Trustworthy Autonomous Systems",

address = "United States",

url = "https://symposium.tas.ac.uk/",

}

Smith, H, Manzini, A, Kennedy, M-R & Ives, JCS 2023, Ethics of Trust/worthiness in Autonomous Systems: a scoping review. in TAS 2023 - Proceedings of the 1st International Symposium on Trustworthy Autonomous Systems., 20, ACM International Conference Proceeding Series, Association for Computing Machinery (ACM), pp. 1-15, First International Symposium on Trustworthy Autonomous
Systems (TAS'23), Edinburgh, United Kingdom, 11/07/23. https://doi.org/10.1145/3597512.3600207

Ethics of Trust/worthiness in Autonomous Systems: a scoping review. / Smith, Helen; Manzini, Arianna; Kennedy, Mari-Rose et al.
TAS 2023 - Proceedings of the 1st International Symposium on Trustworthy Autonomous Systems. Association for Computing Machinery (ACM), 2023. p. 1-15 20 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference Contribution (Conference Proceeding)

TY - GEN

T1 - Ethics of Trust/worthiness in Autonomous Systems

T2 - First International Symposium on Trustworthy Autonomous<br/>Systems (TAS'23)

AU - Smith, Helen

AU - Manzini, Arianna

AU - Kennedy, Mari-Rose

AU - Ives, Jonathan C S

N1 - Funding Information: The UKRI’s Trustworthy Autonomous Systems Node in Functionality (grant number EP/V026518/1) funded HS, AM, and JI to produce this review. Funding Information: JI is in part supported by the NIHR Biomedical Research Centre at University Hospitals Bristol and Weston NHS Foundation Trust and the University of Bristol. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health and Social Care. Funding Information: MRK was funded by emPOWER (EPSRC - EP/T020792/1) when contributing to this work, and is now funded by the NIHR ARC West. Funding Information: HS is additionally supported by the Elizabeth Blackwell Institute, University of Bristol via the Wellcome Trust Institutional Strategic Support Fund. Publisher Copyright: © 2023 Owner/Author.

PY - 2023/7/11

Y1 - 2023/7/11

N2 - The development of adaptive autonomous systems with evolving functionality (AASEFs) differs from their technological predecessors due to their changing, rather than static, architectures and processes; subsequently, their development, deployment, and implementation creates novel ethical issues. Our scoping review surveys the literature to identify the problematic nature of AASEFs, the ethical worries that they generate, and the ethical principles affected. Our literature examination also ascertains stakeholder needs and solutions regarding the trust and trustworthiness of ASSEFs.The characteristics of non-explicability and fluctuating behaviour are predominantly problematic of AASEFs. The literature advocates for AASEF development incorporating ‘ethics by design’ with enforceable standards supported via regulatory and legal structures.

AB - The development of adaptive autonomous systems with evolving functionality (AASEFs) differs from their technological predecessors due to their changing, rather than static, architectures and processes; subsequently, their development, deployment, and implementation creates novel ethical issues. Our scoping review surveys the literature to identify the problematic nature of AASEFs, the ethical worries that they generate, and the ethical principles affected. Our literature examination also ascertains stakeholder needs and solutions regarding the trust and trustworthiness of ASSEFs.The characteristics of non-explicability and fluctuating behaviour are predominantly problematic of AASEFs. The literature advocates for AASEF development incorporating ‘ethics by design’ with enforceable standards supported via regulatory and legal structures.

KW - Ethics

KW - Autonomous Systems

KW - AI

KW - Robotics

KW - Trust

KW - Trustworthiness

KW - Literature Review

U2 - 10.1145/3597512.3600207

DO - 10.1145/3597512.3600207

M3 - Conference Contribution (Conference Proceeding)

T3 - ACM International Conference Proceeding Series

SP - 1

EP - 15

BT - TAS 2023 - Proceedings of the 1st International Symposium on Trustworthy Autonomous Systems

PB - Association for Computing Machinery (ACM)

Y2 - 11 July 2023 through 12 July 2023

ER -

Ethics of Trust/worthiness in Autonomous Systems: a scoping review

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Handle.net

Fingerprint

Projects

UKRI Trustworthy Autonomous Systems Node In Functionality

Cite this