Leibniz-Zentrum Allgemeine Sprachwissenschaft Leibniz-Gemeinschaft

Research Themes

Multimodality, Motion, Speech Production and Perception

The overarching goal of this research topic is to expand our understanding of linguistic representations from a multimodal perspective and their connections to the evolution of language and its sociocultural transmission. Our aim is to explore the complex interplay between language, manual and orofacial gestures on the one hand, and the integration of visual and acoustic stimuli on the other. Special attention is devoted to

  • the integration of orofacial gestures into the prosody of language
  • coordination between body movements and language in the generation of meaning for selected cognitive concepts,
  • the transmission and imitation of meanings through gestures or vocalizations from one person to another, and
  • determining the contribution of contextual visual information to language.

Various data, including motion capture data, acoustic recordings, articulatory recordings, and perceptual recordings, are collected for the analyses.

Research Theme Publications