Epistemic Sets Applied to Best-of-n Problems

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

1 Citation (Scopus)

Abstract

Epistemic sets are a simple and efficient way of representing uncertain beliefs in AI, in which an agent identifies those states or worlds that she deems to be possible. We investigate their application to multi-agent distributed learning and decision making, in particular to best-of-n problems in which a population of agents must reach a consensus by identifying the best out of n possible alternatives or choices, each of different quality. We show that, despite their limited representational power, epistemic sets can be effectively deployed by agents engaged in a learning process in which they receive evidence directly from the environment and also pool or fuse their beliefs with those of other agents, in order to solve a best-of-n problem. We describe an analytical model of such a system based on ordinary differential equations and conduct a fixed point analysis so as to obtain insights into macro-level convergence properties. We then conduct a series of agent-based simulation experiments to investigate the robustness of the epistemic set approach. The results suggest that when applied to best-of-n problems epistemic sets are robust to noise and scalable to large state spaces, even when the population size is relatively small. This in turn supports the claim that they have potential applications in decentralised AI and swarm robotics at a range of different scales.
Original languageEnglish
Title of host publicationLecture Notes in Computer Science
Subtitle of host publicationEuropean Conference on Symbolic and Quantitative Approaches with Uncertainty
PublisherSpringer, Cham
Pages301-312
Number of pages12
Volume11726
ISBN (Electronic)978-3-030-29765-7
ISBN (Print)978-3-030-29764-0
DOIs
Publication statusPublished - Sep 2019

Fingerprint Dive into the research topics of 'Epistemic Sets Applied to Best-of-n Problems'. Together they form a unique fingerprint.

  • Projects

    T-B PHASE: Prosperity Partnership with Thales

    Wilson, R. E., Johnson, A., Bullock, S., Lawry, J., Richards, A. G., Noyes, J. M., Hauert, S., Bode, N. W. F., Wilson, R. E., Pitonakova, L., Kent, T., Crosscombe, M., Zanatto, D., Alkan, B., Drury, K. L., Hogg, E., Bonnell, W. D., Bennett, C. D., Clarke, C. E. M., Wisetjindawat, W., Potts, M. W., Ellinas, C., Sartor, P. N., Harvey, D., Rayneau-Kirkhope, B., Galvin, K., Lam, J., Barden, E. & Chattington, M.

    1/10/1730/09/22

    Project: Research

    Cite this

    Lawry, J., Crosscombe, M., & Harvey, D. (2019). Epistemic Sets Applied to Best-of-n Problems. In Lecture Notes in Computer Science: European Conference on Symbolic and Quantitative Approaches with Uncertainty (Vol. 11726, pp. 301-312). Springer, Cham. https://doi.org/10.1007/978-3-030-29765-7_25