Synthesis of VV utterances from muscle activation to sound with a 3d model

Saeed Dabbaghchian, Marc Arnela, Olov Engwall, Oriol Guasch

Producció científica: Article en revista indexadaArticle de conferènciaAvaluat per experts

5 Cites (Scopus)

Resum

We propose a method to automatically generate deformable 3D vocal tract geometries from the surrounding structures in a biomechanical model. This allows us to couple 3D biomechanics and acoustics simulations. The basis of the simulations is muscle activation trajectories in the biomechanical model, which move the articulators to the desired articulatory positions. The muscle activation trajectories for a vowel-vowel utterance are here defined through interpolation between the determined activations of the start and end vowel. The resulting articulatory trajectories of flesh points on the tongue surface and jaw are similar to corresponding trajectories measured using Electromagnetic Articulography, hence corroborating the validity of interpolating muscle activation. At each time step in the articulatory transition, a 3D vocal tract tube is created through a cavity extraction method based on first slicing the geometry of the articulators with a semi-polar grid to extract the vocal tract contour in each plane and then reconstructing the vocal tract through a smoothed 3D mesh-generation using the extracted contours. A finite element method applied to these changing 3D geometries simulates the acoustic wave propagation. We present the resulting acoustic pressure changes on the vocal tract boundary and the formant transitions for the utterance [Ai].

Idioma originalAnglès
Pàgines (de-a)3497-3501
Nombre de pàgines5
RevistaProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volum2017-August
DOIs
Estat de la publicacióPublicada - 2017
Esdeveniment18th Annual Conference of the International Speech Communication Association, INTERSPEECH 2017 - Stockholm, Sweden
Durada: 20 d’ag. 201724 d’ag. 2017

Fingerprint

Navegar pels temes de recerca de 'Synthesis of VV utterances from muscle activation to sound with a 3d model'. Junts formen un fingerprint únic.

Com citar-ho