Generation the expressive speech in case of tonal languages
type: Dataset
description: Today, the human-computer interaction is reaching the naturalness and is increasingly similar to the human-human interaction, including the expressiveness (especially emotions and attitudes). In spoken communication, attitudes or social affects are mainly transferred through prosody. For tonal languages, prosody is also used to encode semantic information via tones. This thesis presents a study of social affects in Vietnamese, a tonal and under-resourced language, in order to apply the results to Vietnamese expressive speech synthesis task. The first task of this thesis concerns the construction of a first audio-visual corpus of Vietnamese attitudes which contains sixteen attitudes. This corpus is then used to study the audio-visual and intercultural perceptions of the Vietnamese attitudes. A series of perceptual tests was carried out with native and non-native listeners (French for non-native listeners). Experimental results reveal the fact that the influential factors on the perception of attitudes include the modality of presentation (audio, visual and audio-visual) and the attitudinal expression itself. These results also allow us to investigate the common specificities and cross-cultural specificities between Vietnamese and French attitudes. Another perception test was carried out using sentences with tonal variation to study the influence of Vietnamese tones on the perception of attitudes. The results show that non-native listeners can process the local prosodic cues of tones, together with the global cues of attitude patterns. After presenting our studies on Vietnamese social affects, we describe our work on attitude modelling to apply it to Vietnamese expressive speech synthesis. Based on the concept of prosodic contour superposition, a prosodic model was proposed to encode the attitudinal function of prosody for Vietnamese attitudes. This model was applied to generate the Vietnamese expressive speech and then evaluated in a perceptual experiment with synthe…
identifier: NNT: 2012GRENT016
issued: 2026-05-09T20:19:24.067903
language: fr
modified: 2026-05-09T20:19:24.067907
contact point: Organization
  fn: CCSD
keyword: affects-sociaux
keyword: contours-prosodiques
keyword: expressive-speech
keyword: infoeu-reposemanticsdoctoralthesis
keyword: modelisation-de-la-prosodie
keyword: parole-expressive
keyword: prosodic-contours
keyword: prosody-modeling
keyword: social-affects
keyword: speech-synthesis
keyword: spiotherengineering-sciences-physicsother
keyword: synthese-de-la-parole
keyword: theses
keyword: vietnamese
keyword: vietnamienne
landing page: https://theses.hal.science/tel-00859201

Generation the expressive speech in case of tonal languages
type: Distribution
format: HTML
issued: 2026-05-09T20:19:24.078752
modified: 2026-05-09T20:19:24.054322
access URL: https://theses.hal.science/tel-00859201

test_moissonnage_selune
type: Agent