TY - GEN
T1 - DemetrIA
T2 - 26th International Conference of the Catalan Association for Artificial Intelligence, CCIA 2024
AU - Vaquerizo-Serrano, Jesús
AU - Arnela, Marc
N1 - Publisher Copyright:
© 2024 The Authors.
PY - 2024/9/25
Y1 - 2024/9/25
N2 - Voice cloning using artificial intelligence (AI) is possible nowadays. However, it poses many challenges from the ethical point of view. This article examines the potential and ethics of AI for cloning the voice of a deceased family member. In particular, we cloned the voice of grandfather Demetrio, who left his family 50 years ago when he was only 47, leaving many messages to be transmitted. Demetrio's voice was found in an old cassette tape provided by family members. First, his voice was digitalized and denoised using AI techniques. Next, a model of the grandfather's voice was created using replicate, a fine-tune open-source model based on AI. One of his grandsons gave his voice to transmit a message to Demetrio's daughters, which was modulated with the AI model containing the main features of Demetrio's voice. The grandfather model was thus merged with the grandson's voice, using contextualized text to recreate the grandfather's way of communicating. The article addresses the ethical and social implications of this technology, highlighting its therapeutic potential in addressing complex emotions such as bereavement. The importance of an ethical approach in the development and application of AI in this context is emphasized.
AB - Voice cloning using artificial intelligence (AI) is possible nowadays. However, it poses many challenges from the ethical point of view. This article examines the potential and ethics of AI for cloning the voice of a deceased family member. In particular, we cloned the voice of grandfather Demetrio, who left his family 50 years ago when he was only 47, leaving many messages to be transmitted. Demetrio's voice was found in an old cassette tape provided by family members. First, his voice was digitalized and denoised using AI techniques. Next, a model of the grandfather's voice was created using replicate, a fine-tune open-source model based on AI. One of his grandsons gave his voice to transmit a message to Demetrio's daughters, which was modulated with the AI model containing the main features of Demetrio's voice. The grandfather model was thus merged with the grandson's voice, using contextualized text to recreate the grandfather's way of communicating. The article addresses the ethical and social implications of this technology, highlighting its therapeutic potential in addressing complex emotions such as bereavement. The importance of an ethical approach in the development and application of AI in this context is emphasized.
KW - AI voice cloning
KW - Ethical
KW - Social aspects of AI
UR - https://www.scopus.com/pages/publications/85217022590
UR - http://hdl.handle.net/20.500.14342/6071
U2 - 10.3233/FAIA240430
DO - 10.3233/FAIA240430
M3 - Conference contribution
AN - SCOPUS:85217022590
T3 - Frontiers in Artificial Intelligence and Applications
SP - 164
EP - 173
BT - Artificial Intelligence Research and Development - Proceedings of the 26th International Conference of the Catalan Association for Artificial Intelligence
A2 - Alsinet, Teresa
A2 - Vilasis--Cardona, Xavier
A2 - Garcia-Costa, Daniel
A2 - Alvarez-Garcia, Elena
PB - IOS Press BV
Y2 - 2 October 2024 through 4 October 2024
ER -