DemetrIA: Artificial Intelligence and Ethics for the Voice Cloning of Grandfather Demetrio

Jesús Vaquerizo-Serrano*, Marc Arnela

*Autor corresponent d’aquest treball

Producció científica: Capítol de llibreContribució a congrés/conferènciaAvaluat per experts

Resum

Voice cloning using artificial intelligence (AI) is possible nowadays. However, it poses many challenges from the ethical point of view. This article examines the potential and ethics of AI for cloning the voice of a deceased family member. In particular, we cloned the voice of grandfather Demetrio, who left his family 50 years ago when he was only 47, leaving many messages to be transmitted. Demetrio's voice was found in an old cassette tape provided by family members. First, his voice was digitalized and denoised using AI techniques. Next, a model of the grandfather's voice was created using replicate, a fine-tune open-source model based on AI. One of his grandsons gave his voice to transmit a message to Demetrio's daughters, which was modulated with the AI model containing the main features of Demetrio's voice. The grandfather model was thus merged with the grandson's voice, using contextualized text to recreate the grandfather's way of communicating. The article addresses the ethical and social implications of this technology, highlighting its therapeutic potential in addressing complex emotions such as bereavement. The importance of an ethical approach in the development and application of AI in this context is emphasized.

Idioma originalAnglès
Títol de la publicacióArtificial Intelligence Research and Development - Proceedings of the 26th International Conference of the Catalan Association for Artificial Intelligence
EditorsTeresa Alsinet, Xavier Vilasis--Cardona, Daniel Garcia-Costa, Elena Alvarez-Garcia
EditorIOS Press BV
Pàgines164-173
Nombre de pàgines10
ISBN (electrònic)9781643685434
DOIs
Estat de la publicacióPublicada - 25 de set. 2024
Esdeveniment26th International Conference of the Catalan Association for Artificial Intelligence, CCIA 2024 - Barcelona, Spain
Durada: 2 d’oct. 20244 d’oct. 2024

Sèrie de publicacions

NomFrontiers in Artificial Intelligence and Applications
Volum390
ISSN (imprès)0922-6389
ISSN (electrònic)1879-8314

Conferència

Conferència26th International Conference of the Catalan Association for Artificial Intelligence, CCIA 2024
País/TerritoriSpain
CiutatBarcelona
Període2/10/244/10/24

Fingerprint

Navegar pels temes de recerca de 'DemetrIA: Artificial Intelligence and Ethics for the Voice Cloning of Grandfather Demetrio'. Junts formen un fingerprint únic.

Com citar-ho