Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events.

van der Burg, Erik; Cass, John; Olivers, Christian N. L.; Theeuwes, Jan; Alais, David

Background: A prevailing view is that audiovisual integration requires temporally coincident signals. However, a recent study failed to find any evidence for audiovisual integration in visual search even when using synchronized audiovisual events. An important question is what information is critical to observe audiovisual integration. Methodology/Principal Findings: Here we demonstrate that temporal coincidence (i.e., synchrony) of auditory and visual components can trigger audiovisual interaction in cluttered displays and consequently produce very fast and efficient target identification. In visual search experiments, subjects found a modulating visual target vastly more efficiently when it was paired with a synchronous auditory signal. By manipulating the kind of temporal modulation (sine wave vs. square wave vs. difference wave; harmonic sine-wave synthesis; gradient of onset/offset ramps) we show that abrupt visual events are required for this search efficiency to occur, and that sinusoidal audiovisual modulations do not support efficient search. Conclusions/Significance: Thus, audiovisual temporal alignment will only lead to benefits in visual search if the changes in the component signals are both synchronized and transient. We propose that transient signals are necessary in synchrony-driven binding to avoid spurious interactions with unrelated signals when these occur close together in time.

SOUND; AUDITORY pathways; SENSE organs; SQUARE waves; AUDITORY perception; VISUAL perception; ELECTRONIC modulation

PLoS ONE, 2010, Vol 5, Issue 5, p1

1932-6203

Academic Journal

10.1371/journal.pone.0010664