Audiovisual analysis and synthesis for multimodal human-computer interfaces

Xavier Sevillano, Javier Melenchón, Germán Cobo, Joan Claudi Socoró, Francesc Alías

Research output: Book chapterConference contributionpeer-review

Abstract

Multimodal signal processing techniques are called to play a salient role in the implementation of natural computer-human interfaces. In particular, the development of efficient interface front ends that emulate interpersonal communication would benefit from the use of techniques capable of processing the visual and auditory modes jointly. This work introduces the application of audiovisual analysis and synthesis techniques based on Principal Component Analysis and Non-negative Matrix Factorization on facial audiovisual sequences. Furthermore, the applicability of the extracted audiovisual bases is analyzed throughout several experiments that evaluate the quality of audiovisual resynthesis using both objective and subjective criteria.

Original languageEnglish
Title of host publicationEngineering the User Interface
Subtitle of host publicationFrom Research to Practice
PublisherSpringer London
Pages179-194
Number of pages16
ISBN (Print)9781848001350
DOIs
Publication statusPublished - 2009
Event7th International Conference on Interaccion Persona-Ordenador, IPO 2006 - 7th International Conference on Human-Computer Interaction, HCI 2006 - Puertollano, Ciudad Real, Spain
Duration: 13 Nov 200617 Nov 2006

Publication series

NameEngineering the User Interface: From Research to Practice

Conference

Conference7th International Conference on Interaccion Persona-Ordenador, IPO 2006 - 7th International Conference on Human-Computer Interaction, HCI 2006
Country/TerritorySpain
CityPuertollano, Ciudad Real
Period13/11/0617/11/06

Fingerprint

Dive into the research topics of 'Audiovisual analysis and synthesis for multimodal human-computer interfaces'. Together they form a unique fingerprint.

Cite this