TY - GEN
T1 - Modelling Moral Decision-Making in a Contractualist Artificial Agent
AU - Dalmasso, Giovanni
AU - Marcos-Vidal, Luis
AU - Pretus, Clara
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.
PY - 2025
Y1 - 2025
N2 - As artificial intelligence (AI) systems become increasingly integrated into our daily lives, ensuring their ethical behavior is paramount. This paper introduces a novel approach to embedding moral cognition in AI based on contractualism, an ethical theory that deems actions appropriate if they can be justified based on the set of norms that govern interactions between pairs of agents. Our model, embodied in a robotic cleaning agent named Sweepy, makes decisions based on a combination of predefined norms and dynamic user feedback. This hybrid decision-making process allows Sweepy to align its behavior with individual user preferences, thus enhancing user satisfaction. Through extensive simulations, we demonstrate Sweepy’s ability to learn and adapt its actions across different scenarios, illustrating the model’s robustness and flexibility. This study highlights the advantages of the contractualist approach over utilitarian and deontological models, particularly in their support of user autonomy and fairness. Our findings underscore the need to develop AI systems capable of making ethically sound decisions in complex, real-world environments, paving the way for more trustworthy and user-centric AI applications.
AB - As artificial intelligence (AI) systems become increasingly integrated into our daily lives, ensuring their ethical behavior is paramount. This paper introduces a novel approach to embedding moral cognition in AI based on contractualism, an ethical theory that deems actions appropriate if they can be justified based on the set of norms that govern interactions between pairs of agents. Our model, embodied in a robotic cleaning agent named Sweepy, makes decisions based on a combination of predefined norms and dynamic user feedback. This hybrid decision-making process allows Sweepy to align its behavior with individual user preferences, thus enhancing user satisfaction. Through extensive simulations, we demonstrate Sweepy’s ability to learn and adapt its actions across different scenarios, illustrating the model’s robustness and flexibility. This study highlights the advantages of the contractualist approach over utilitarian and deontological models, particularly in their support of user autonomy and fairness. Our findings underscore the need to develop AI systems capable of making ethically sound decisions in complex, real-world environments, paving the way for more trustworthy and user-centric AI applications.
KW - Contractualism
KW - Ethical Decision-Making
KW - Moral AI
KW - Moral Artificial Agent
UR - http://www.scopus.com/inward/record.url?scp=105001317891&partnerID=8YFLogxK
U2 - 10.1007/978-3-031-85463-7_10
DO - 10.1007/978-3-031-85463-7_10
M3 - Conference contribution
AN - SCOPUS:105001317891
SN - 9783031854620
T3 - Lecture Notes in Computer Science
SP - 155
EP - 175
BT - Value Engineering in Artificial Intelligence - 2nd International Workshop, VALE 2024, Revised Selected Papers
A2 - Osman, Nardine
A2 - Steels, Luc
PB - Springer Science and Business Media Deutschland GmbH
T2 - 2nd International Workshop on Value Engineering in Artificial Intelligence, VALE 2024
Y2 - 19 October 2024 through 24 October 2024
ER -