Mainnavigation

      • DE
      • EN
    • Watchlist
    • Menu Menu
    You are here:
    1. Research Projects
    More: Research Projects

    Motion Gesture Music

    Institute for Computer Music and Sound Technology (ICST)

    Music moves us, not just metaphorically, but also through the body. The project investigates the role of motion in composition and performance of music, and the way movement carries meaning and becomes gesture, which shapes our understanding of music.

    In music and performance research, the focus has shifted away from the score towards the body. Psychology of music is investigating how physical movement influences our perception of music. Much research is done to measure and identify movements and their expressive characteristics, yet in the field of music composition methods to work with the concept of gesture are missing. In live-electronic styles, however, using gestures has become a standard practice.

    The goal of the project is to develop analysis methods that enable the identification of gestures in composition and performance. Artistic practice is joined by three academic disciplines. Psychological research identifies gesture categories that inform music-perception. Music Technology uses motion data to recognise and categorise gestures in an automated way. And Music Analysis builds a framework for gestures classification in composition and performance.

    The project contributions occur in these three domains. They extend the concepts in music psychology by categorisations, extends the predominant approach in music analysis by adding gesture as a foundational category and provides tools and methods for automated gesture analysis.
    The project results benefit musicians situated at the intersections of art and science. The project provides a conceptual framework used to analyse musical works from a variety of styles, which again profits students in the domains of electro-acoustic composition, live-electronic performance and even media-arts.

    Details

    • Research Focus
      • FSP Technologie und Musikalische Praxis
    • Project Lead
      • Jan Schacher (ICST)
    • Team
      • Daniel Bisig (ICST)
      • Hanna Järveläinen (ICST)
      • Chikashi Miyama (ICST)
      • Patrick Karl Alois Neff (ICST)
      • Christian Strinning (ICST)
      • Germán Toro-Pérez (ICST)
    • Cooperations
      • Goldsmiths College, University of London
      • IRCAM Paris
      • Universitetet i Oslo, Department of Musicology
      • Vrije Universiteit Brussel
    • Resources
      • Project website
    • Duration

      01.12.2013 – 29.02.2016

    • Financing
      • Schweizerischer Nationalfonds SNF (01.01.2014 – 29.02.2016)
    • Research Approaches
      • Applied research
      • Artistic-scientific research
    • Keywords

      Computer Music, Motion Analysis, Music Analysis, Typology, Taxonomy, Methodologies, Embodiment, Gesture, Wahrnehmungspsychologie

    • Downloads
      • MGM_Poster_20140115.pdf

    Output

    • Aufsätze in Sammelbänden, Ausstellungskatalogen, Buchbeiträge

      Schacher, Jan / Stöcklin, Angela (2017): «Unequal Twins, Asymmetrically Coupled». In: Kaross, Sabine / Schroedter, Stephanie (Hg.): Klänge in Bewegung Spurensuchen in Choreografie und Performance. Bielefeld: transcript, 143–152.

    • Aufsätze in Fachzeitschriften

      Schacher, Jan & Neff, Patrick (2017): «Moving Through the Double Vortex. Exploring Corporeality In and Through Performance Creation». Journal for Artistic Research. 12. Online unter: https://doi.org/10.22501/jar.254382.

    • Aufsätze in Fachzeitschriften

      Schacher, Jan & Stöcklin, Angela (2016): «Sounding bodies – moving sounds. Encounters in improvised play across disciplines and cultures». Arts and Humanities in Higher Education. The Reflective Conservatoire: A&HHE Peer reviewed Digital Special Issue. Online unter: http://www.artsandhumanities.org/journal/sounding-bodies-moving-sounds-encounters-in-improvised-play-across-disciplines-and-cultures/.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan & Bisig, Daniel (2016): «Face to Face. Performers and Algorithms in Mutual Dependency». In: Magnusson, Thor / Kiefer, Chris & Duffy, Sam (Hg.): Proceedings of the International Conference on Live-Interfaces. 80–88. Online unter: http://users.sussex.ac.uk/~thm21/ICLI_proceedings/ICLI-2016-ProceedingsHI.pdf.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan & Bisig, Daniel (2016): «Face to Face. Performers and Algorithms in Mutual Dependency». In: Magnusson, Thor / Kiefer, Chris & Duffy, Sam (Hg.): Proceedings of the International Conference on Live Interfaces. N/A–N/A. Online unter: http://users.sussex.ac.uk/~thm21/ICLI_proceedings/ICLI-2016-ProceedingsHI.pdf.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan & Neff, Patrick (2016): «Skill Development and Stabilisation of Expertise for Electronic Music Performance». In: Kronland-Martinet, Richard / Aramaki, Mitsuko & Ystad, Sølvi (Hg.): Music, Mind, and Embodiment. 11th International Symposium, CMMR 2015, Plymouth, UK, June 16-19, 2015, Revised Selected Paper. Lecture Notes in Computer Science. Cham: Springer, 111–131. Online unter: https://doi.org/10.1007/978-3-319-46282-0_7.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan (2016): «Moving Music. Exploring Movement-to-Sound Relationships». Proceedings of the 3rd International Symposium on Movement and Computing (MOCO'16). Thessaloniki, Greece: ACM org, N/A–N/A. Online unter: https://dl.acm.org/citation.cfm?id=2948910&picked=prox.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan / Bisig, Daniel & Neff, Patrick (2016): «Exploring Gesturality in Music Performance». Proceedings of the 13th Sound and Music Computing Conference (SMC). 407–414. Online unter: https://doi.org/10.5281/zenodo.851295.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan & Neff, Patrick (2015): «The Fluid and the Crystalline. Processes of the Music Performing and Perceiving Body». Proceedings of the 11th International Symposium on Computer Music Multidisciplinary Research. 333–349. Online unter: https://www.jasch.ch/pub/CMMR2015_Schacher_Fluid.pdf.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan (2015): «Music Means Movement. Musings on Methods of Movement Analysis in Music,». MOCO '15 Proceedings of the 2nd International Workshop on Movement and Computing. Vancouver, Canada: ACM New York, NY, USA, 132–139. Online unter: http://dx.doi.org/10.1145/2790994.2791001.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan / Bisig, Daniel & Miyama, Chikashi (2015): «Gestural Electronic Music using Machine Learning as Generative Device». Proceedings of the International Conference on New Interfaces for Musical Expression. 347–350. Online unter: https://doi.org/10.5281/zenodo.1179172.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan / Järveläinen, Hanna / Strinning, Christian & Neff, Patrick (2015): «Movement Perception in Music Performance. A Mixed Methods Investigation». Proceedings of the 12th Sound and Music Computing Conference (SMC2015). 185–192. Online unter: https://doi.org/10.5281/zenodo.1400777.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan (2014): «Corporeality, Actions and Perceptions in Gestural Performance of Digital Music». Proceedings of the Joint International Computer Music and Sound and Music Computing Conference (ICMC-SMC). 629–636. Online unter: https://core.ac.uk/reader/144846440.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan (2014): «Investigating Gestural Electronic Music». Practice-Based Research Workshop at NIME 2014 (30th June, 2014). Sydney: Creativity and Cognition Studios

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Schacher, Jan C. & Bisig, Daniel (2014): «Watch This! Expressive Movement in Electronic Music Performance». MOCO '14: International Workshop on Movement and Computing. 106–111. Online unter: https://doi.org/10.1145/2617995.2618014.

    • Ausstellungen, Konzerte, Aufführungen, Filmpräsentationen etc.

      Schacher, Jan (2016): «Gestural Music – Moving Music II, Concert». ZHdK.

    • Ausstellungen, Konzerte, Aufführungen, Filmpräsentationen etc.

      Schacher, Jan (2015): «Gestural Music – Moving Music, Concert». ZHdK.

    • Konzept, Organisation und Durchführung

      Schacher, Jan (2015): «2nd Workshop on Motion Gesture Music,». 25.01.2001–26.01.2016. ZHdK.

    • Vorträge, Referate

      Schacher, Jan (2016): «Absent Presence, Uncovering/Recovering Performing Arts Practices». World Archaeology Congress WAC8. 28.08.2016–02.09.2016. Kyoto, Japan.

    • Vorträge, Referate

      Schacher, Jan (2016): «Face to Face – Performers and Algorithms in Mutual Dependency». ICLI'16: International Conference on Live-Interfaces. 29.06.2016–03.07.2016. University of Sussex, Brighton.

    • Vorträge, Referate

      Schacher, Jan (2016): «Moving Music: Exploring Movement-to-Sound Relationships». MOCO'16: 3rd International Symposium on Movement and Computing. 03.07.2016–06.07.2016. Thessaloniki.

    • Vorträge, Referate

      Schacher, Jan / Stöcklin, Angela (2016): «Moving Music, A Lecture-Performance». Sound – Traces – Moves: Klangspuren in Bewegung, Symposium 2016, Gesellschaft für Tanzforschung. 18.11.2016–20.11.2016. Salzburg, Austria. Online unter: https://www.gtf-tanzforschung.de/tagungen/fruehere-symposien/symposium-2016/.

    • Vorträge, Referate

      Schacher, Jan (2015): «Gestural Electronic Music using Machine Learning as Generative Device». International Conference on New Interfaces for Musical Expression NIME’15. 31.05.2015–03.06.2015. Louisiana State University, Baton Rouge.

    • Vorträge, Referate

      Schacher, Jan (2015): «Movement Perception in Music Performance – A Mixed Methods Investigation». The 12th Sound and Music Computing Conference SMC’15. 26.07.2015–01.08.2015. Maynooth University, Maynooth.

    • Vorträge, Referate

      Schacher, Jan (2015): «Music Means Movement – Musings on Methods for Movement Analysis in Music». MOCO’15: Second International Workshop on Movement and Computing. 14.08.2015–15.08.2015. Simon Fraser University, Vancouver.

    • Vorträge, Referate

      Schacher, Jan (2015): «The Fluid and the Crystalline — Processes of the Music Performing and Perceiving Body». The 11th International Symposium on Computer Music Multidisciplinary Research CMMR'15. 17.06.2015–19.06.2015. Plymouth.

    • Vorträge, Referate

      Schacher, Jan & Miama, Chikashi (2014): «Investigating Gestural Electronic Music». NIME’14: International Conference on New Interfaces for Musical Expression. 30.06.2014–04.07.2014. London.

    • Vorträge, Referate

      Schacher, Jan (2014): «Corporeality, Actions and Perceptions in Gestural Performance of Digital Music». Joint International Computer Music and Sound and Music Computing Conference ICMC|SMC'14. 14.09.2014–20.09.2014. Athens.

    • Vorträge, Referate

      Schacher, Jan (2014): «Watch This! Expressive Movement in Electronic Music Performance». International Workshop on Movement and Computing MOCO'14. 17.06.2014–18.06.2014. IRCAM, Paris.

    • Teilnahmen auf Einladung

      Schacher, Jan (2016): «Mediated Presence - Explorations on corporeality and embodiment in electronic music performance». ArtSearch, Symposium künstlerische Forschung. 07.04.2016–08.04.2016. HfM Hamburg, Germany.

    • Webseiten

      Schacher, Jan (2015): «Motion Gesture Music». In: Schacher, Jan (Hg.): Zürich: Online unter: http://mgm.zhdk.ch.