Effects of separating auditory and visual sources on audiovisual integration of speech

Jeffery A. Jones, Kevin G. Munhall

Abstract


When the image of a speaker saying the bisyllable /aga/ is presented in synchrony with the sound of a speaker saying /aba/, subjects tend to report hearing the sound /ada/. The present experiment explores the effects of spatial separation on this class of perceptual illusion known as the McGurk effect. Synchronous auditory and visual speech signals were presented from different locations. The auditory signal was presented from positions 0°, 30°, 60° and 90° in azimuth away from the visual signal source. The results show that spatial incongruencies do not substantially influence the multimodal integration of speech signals.

Keywords


Audition; Speech; Speech intelligibility; Vision; Audiovisual integration; McGurk effect

Full Text:

PDF

Refbacks

  • There are currently no refbacks.