Hearing flashes and seeing beeps: Timing audiovisual events - Aix-Marseille Université Access content directly
Journal Articles PLoS ONE Year : 2017

Hearing flashes and seeing beeps: Timing audiovisual events

Manuel Vidal

Abstract

Many events from daily life are audiovisual (AV). Handclaps produce both visual and acoustic signals that are transmitted in air and processed by our sensory systems at different speeds, reaching the brain multisensory integration areas at different moments. Signals must somehow be associated in time to correctly perceive synchrony. This project aims at quantifying the mutual temporal attraction between senses and characterizing the different interaction modes depending on the offset. In every trial participants saw four beep-flash pairs regularly spaced in time, followed after a variable delay by a fifth event in the test modality (auditory or visual). A large range of AV offsets was tested. The task was to judge whether the last event came before/after what was expected given the perceived rhythm, while attending only to the test modality. Flashes were perceptually shifted in time toward beeps, the attraction being stronger for lagging than leading beeps. Conversely, beeps were not shifted toward flashes, indicating a nearly total auditory capture. The subjective timing of the visual component resulting from the AV interaction could easily be forward but not backward in time, an intuitive constraint stemming from minimum visual processing delays. Finally, matching auditory and visual time-sensitivity with beeps embedded in pink noise produced very similar mutual attractions of beeps and flashes. Breaking the natural auditory preference for timing allowed vision to take over as well, showing that this preference is not hardwired.
Fichier principal
Vignette du fichier
Vidal (2017) - PlosOne - Timing audiovisual events.pdf (1.38 Mo) Télécharger le fichier
Origin : Publisher files allowed on an open archive
Loading...

Dates and versions

hal-01473873 , version 1 (22-02-2017)

Identifiers

Cite

Manuel Vidal. Hearing flashes and seeing beeps: Timing audiovisual events. PLoS ONE, 2017, 44, pp.2875 - 2875. ⟨10.1371/journal.pone.0172028⟩. ⟨hal-01473873⟩
67 View
99 Download

Altmetric

Share

Gmail Facebook X LinkedIn More