Effects of mouthing and interlocutor presence on movements of visible vs. non-visible articulators
Keywords:speech production, interlocutor effects, mouthed speech, auditory and visual feedback, ultrasound imaging
AbstractSpeakers take into account what information a conversation partner requires in a given context in order to best understand an utterance. Despite growing evidence showing that movements of visible articulators such as the lips are augmented in mouthed speech relative to vocalized speech, little to date has been done comparing this effect in visible vs. non-visible articulators. In addition, no studies have examined whether interlocutor engagement differentially impacts these. Building on a basic present/not-present design, we investigated whether presence of audible speech information and/or an interlocutor affect the movements of the lips and the tongue. Participants were asked to a) speak or b) mouth three target syllables in interlocutor-present and interlocutor-not-present conditions, while lip and tongue movements were recorded using video and ultrasound imaging. Results show that lip protrusion was greater in mouthed conditions compared to vocalized ones and tongue movements were either attenuated (/wa/) or unaffected (/ri/, /ra/) by these same conditions, indicating differential effects for the visible and non-visible articulators in the absence of an auditory signal. A significant interaction between the social engagement and vocalizing conditions in reference to lip aperture showed that participants produced smaller lip apertures when vocalizing alone, as compared to when in the presence of an interlocutor. However, measures of lip protrusion failed to find an effect of social engagement. We conclude that speakers make use of both auditory and visual modalities in the presence of an interlocutor, and that when acoustic information is unavailable, compensatory increases are made in the visual domain. Our findings shed new light on the multimodal nature of speech, and pose new questions about differential adaptations made by visible and non-visible articulators in different speech conditions.
How to Cite
Author Licensing Addendum
This Licensing Addendum ("Addendum") is entered into between the undersigned Author(s) and Canadian Acoustics journal published by the Canadian Acoustical Association (hereinafter referred to as the "Publisher"). The Author(s) and the Publisher agree as follows:
Retained Rights: The Author(s) retain(s) the following rights:
- The right to reproduce, distribute, and publicly display the Work on the Author's personal website or the website of the Author's institution.
- The right to use the Work in the Author's teaching activities and presentations.
- The right to include the Work in a compilation for the Author's personal use, not for sale.
Grant of License: The Author(s) grant(s) to the Publisher a worldwide exclusive license to publish, reproduce, distribute, and display the Work in Canadian Acoustics and any other formats and media deemed appropriate by the Publisher.
Attribution: The Publisher agrees to include proper attribution to the Author(s) in all publications and reproductions of the Work.
No Conflict: This Addendum is intended to be in harmony with, and not in conflict with, the terms and conditions of the original agreement entered into between the Author(s) and the Publisher.
Copyright Clause: Copyright on articles is held by the Author(s). The corresponding Author has the right to grant on behalf of all Authors and does grant on behalf of all Authors, a worldwide exclusive license to the Publisher and its licensees in perpetuity, in all forms, formats, and media (whether known now or created in the future), including but not limited to the rights to publish, reproduce, distribute, display, store, translate, create adaptations, reprints, include within collections, and create summaries, extracts, and/or abstracts of the Contribution.