Cookies on this website
We use cookies to ensure that we give you the best experience on our website. If you click 'Continue' we'll assume that you are happy to receive all cookies and you won't see this message again. Click 'Find out more' for information on how to change your cookie settings.

Multisensory integration is a powerful mechanism for increasing adaptive responses, as illustrated by binding of fear expressed in a face with fear present in a voice. To understand the role of awareness in intersensory integration of affective information we studied multisensory integration under conditions of conscious and nonconscious processing of the visual component of an audiovisual stimulus pair. Auditory-event-related potentials were measured in two patients (GY and DB) who were unable to perceive visual stimuli consciously because of striate cortex damage. To explore the role of conscious vision of audiovisual pairing, we also compared audiovisual integration in either naturalistic pairings (a facial expression paired with an emotional voice) or semantic pairings (an emotional picture paired with the same voice). We studied the hypothesis that semantic pairings, unlike naturalistic pairings, might require mediation by intact visual cortex and possibly by feedback to primary cortex from higher cognitive processes. Our results indicate that presenting incongruent visual affective information together with the voice translates as an amplitude decrease of auditory-event-related potentials. This effect obtains for both naturalistic and semantic pairings in the intact field, but is restricted to the naturalistic pairings in the blind field.

Original publication

DOI

10.1073/pnas.062018499

Type

Journal article

Journal

Proc Natl Acad Sci U S A

Publication Date

19/03/2002

Volume

99

Pages

4121 - 4126

Keywords

Acoustic Stimulation, Adult, Analysis of Variance, Auditory Perception, Blindness, Cognition, Discrimination (Psychology), Electroencephalography, Electrooculography, Evoked Potentials, Auditory, Facial Expression, Fear, Feedback, Physiological, Humans, Male, Middle Aged, Photic Stimulation, Unconscious (Psychology), Visual Cortex, Visual Fields, Visual Perception, Voice Quality