Comparison and combination of visual aud audio renderings to conceive human-computer interfaces : from human factors to distortion-based presentation strategies
type: Dataset
description: Although more and more sound and audiovisual data are available, the majority of access interfaces are solely based on a visual presentation. Many visualization techniques have been proposed that use simultaneous presentation of multiple documents and distortions to highlight the most relevant information. We propose to define equivalent audio technique for the presentation of several competing sound files, and optimally combine such audio and visual presentation strategies for multimedia documents. To better adapt these strategies to the user, we studied attentional and perceptual processes involved in listening and watching simultaneous audio-visual objects, focusing on the interactions between the two modalities.Combining visual size and sound level parameters, we extended the visual concept of magnifying lens to auditory and audiovisual modalities. Exploiting this concept, a navigation application in a video collection has been developed. We compared our tool with another rendering mode called Pan & Zoom through a usability study. Results, especially subjective results, encourage further research to develop multimodal presentation strategies by combining an audio rendering to the visual renderings already available.A second study concerned the identification of environmental sounds in a noisy environment in the presence of a visual context. The noise simulated the presence of multiple competing sounds as would be observed in an interface where several multimedia documents are presented together. The experimental results confirmed the multimodality advantage in condition of audio degradation. Moreover, beyond the primary goals of the thesis, this study confirms the importance of the semantic congruency between visual and auditory components for object recognition and provides deeper knowledge about the auditory perception of environmental sounds.Finally, we investigated attentional processes involved in the search of a specific object among many, especially the “…
landing page: https://theses.hal.science/tel-00770309
identifier: NNT: 2012PA112248
keyword: audiovisual-integration
keyword: auditive-et-multisensorielle
keyword: auditory-and-multisensorial-perception
keyword: design-dinteraction-sonore
keyword: exploration-de-collection-multimedia
keyword: exploration-of-multimedia-collection
keyword: focuscontext-techniques
keyword: infoeu-reposemanticsdoctoralthesis
keyword: infoinfo-ohcomputer-science-csother-csoh
keyword: integration-audiovisuelle-en-sortie
keyword: interfaces-multimodales
keyword: multimodal-interfaces
keyword: perception-visuelle
keyword: presentation-strategies
keyword: sonic-interaction-design
keyword: strategies-de-presentation-de-linformation
keyword: techniques-focuscontexte
keyword: theses
keyword: visual
issued: 2026-05-15T13:45:09.080019
modified: 2026-05-15T13:45:09.080035
language: fr
contact point: Organization
  fn: CCSD

test_moissonnage_selune
type: Agent

Comparison and combination of visual aud audio renderings to conceive human-computer interfaces : from human factors to distortion-based presentation strategies
type: Distribution
format: HTML
access URL: https://theses.hal.science/tel-00770309
issued: 2026-05-15T13:45:09.143656
modified: 2026-05-15T13:45:09.020596