Using multiple stream recordings, the gesture research team develops empirical methods for multimodal communication and interaction research. In addition to regular and high-speed video cameras, a state-of-the-art Motion-Capture system is used to record movements of hands, head and torso in real-time and within millimeter accuracy. This enables the Natural Media Group to visualise and statistically analyse ephemeral gestural forms and movements. Theory-building combines semiotics and cognitivelinguistics. Current work involves tools and methods to compile and analyse multimodal corpora (semi-) automatically for purposes of pattern recognition.
Natural Media & Engineering - Linguistic, semiotic, neuroscientific, and technical perspectives on the production und reception of natural media (spoken and signed languages, gesture, mimics, posture)
e-cosmos - Integrating electronic tools for the analysis of complex multimodal data in the humanities
NeuroPeirce - Gesture as test ground for Peirce’s universal categories in the social neurosciences
Manufacturing communication - Gesture codes for industrial production contexts
Research funding (selection)
Excellence Initiative of the German Federal and State Governments (HumTec, RWTH Aachen Institutional Strategy), Alexander-von-Humboldt Foundation