Cross-modal melodic contour similarity

Authors

  • Jon B. Prince Department of Psychology, University of Toronto, Mississauga, Canada
  • Mark A. Schmuckler Department of Psychology, University of Toronto, Mississauga, Canada
  • William Forde Thompson Department of Psychology, Macquarie University, Sydney, Australia

Keywords:

Fourier analysis, Surface structure, Auditory visuals, Contour models, Cross modals, Line drawings, Phase spectrum, Relative positions

Abstract

In two experiments participants rated the similarity of melodic contours presented as auditory (melodies) and visual (line drawings) stimuli. Longer melodies were assessed in Experiment 1 (M = 35 notes); shorter melodies were assessed in Experiment 2 (M = 17 notes). Ratings for matched auditory and visual contours exceeded ratings for mismatched contours, confirming cross-modal sensitivity to contour. The degree of overlap of the surface structure (the relative position of peaks and troughs), and the strength and timing of the cyclical information (the amplitude and phase spectra produced by a Fourier analysis) in the contours predicted cross-modal similarity ratings. Factors such as the order of stimulus presentation (auditory-visual or visual-auditory), melody length (long versus short), and musical experience also affected the perceived similarity of contours. Results validate the applicability of existing contour models to cross-modal contexts and reveal additional factors that contribute to cross-modal contour similarity.

Downloads

Published

2009-03-01

How to Cite

1.
Prince JB, Schmuckler MA, Thompson WF. Cross-modal melodic contour similarity. Canadian Acoustics [Internet]. 2009 Mar. 1 [cited 2023 May 29];37(1):35-49. Available from: https://jcaa.caa-aca.ca/index.php/jcaa/article/view/2114

Issue

Vol. 37 No. 1 (2009)

Section

Technical Articles

License

Copyright on articles is held by the author(s). The corresponding author has the right to grant on behalf of all authors and does grant on behalf of all authors, a worldwide exclusive licence (or non-exclusive license for government employees) to the Publishers and its licensees in perpetuity, in all forms, formats and media (whether known now or created in the future)
i)    to publish, reproduce, distribute, display and store the Contribution;
ii)    to translate the Contribution into other languages, create adaptations, reprints, include within collections and create summaries, extracts and/or, abstracts of the Contribution;
iii)    to exploit all subsidiary rights in the Contribution,
iv)    to provide the inclusion of electronic links from the Contribution to third party material where-ever it may be located;
v)    to licence any third party to do any or all of the above.