Multimodal human-machine dialogue: from pragmatic linguistics to system design

Human-machine dialogue aims at providing natural dialogue in natural language, i.e., allowing the user to speak using his own language (natural language), following a structure of moves and exchanges that is similar to human dialogue structure (natural dialogue). Related research works feed on linguistics, which analyses language markers, and pragmatics, which analyses language use in context. Two important sectors of linguistic pragmatics focus on referring phenomena, for instance referring to the objects that are accessible in the dialogue context, and speech acts, or dialogue acts, i.e., communicative actions carried out by utterances. We present our modelling and formalizing works dealing with these two aspects and with their application to dialogue systems, particularly when a visual scene is implied or when co-verbal gestures are processed together with speech (multimodal dialogue). Human-machine dialogue also aims at facilitating the design and development of effective systems, with methodologies and means like software architectures. We present our theoretical and practical works in this way, illustrated by our participation to several European projects. We then propose some future works that focus on the integration of linguistic and pragmatic phenomena like salience and ambiguity to human-machine dialogue.

Data and Resources

Additional Info

Field Value
Source https://theses.hal.science/tel-00848533
Author Landragin, Frédéric
Maintainer CCSD
Last Updated May 10, 2026, 05:18 (UTC)
Created May 10, 2026, 05:18 (UTC)
Identifier tel-00848533
Language fr
Rights https://about.hal.science/hal-authorisation-v1/
contributor Lattice - Langues, Textes, Traitements informatiques, Cognition - UMR 8094 (Lattice) ; Université Sorbonne Nouvelle - Paris 3-Université Sorbonne Paris Cité (USPC)-Centre National de la Recherche Scientifique (CNRS)-Université Paris Sciences et Lettres (PSL)-Département Littératures et langage - ENS-PSL (LILA) ; École normale supérieure - Paris (ENS-PSL) ; Université Paris Sciences et Lettres (PSL)-Université Paris Sciences et Lettres (PSL)-École normale supérieure - Paris (ENS-PSL) ; Université Paris Sciences et Lettres (PSL)
creator Landragin, Frédéric
date 2013-06-28T00:00:00
harvest_object_id afe3ed24-cf2f-4bef-8410-390e5009cfe9
harvest_source_id 3374d638-d20b-4672-ba96-a23232d55657
harvest_source_title test moissonnage SELUNE
metadata_modified 2024-12-09T00:00:00
set_spec type:HDR