Mainnavigation

      • DE
      • EN
    • Watchlist
    • Menu Menu
    You are here:
    1. Research Projects
    More: Research Projects

    Design and evaluation of haptic musical interfaces

    Institute for Computer Music and Sound Technology (ICST)

    While performing on traditional instruments, the player's haptic channel is involved in a complex action-perception loop. Accordingly, we expect that digital musical instruments (DMIs) will especially gain from haptic technology. The project investigates how haptic feedback in musical interaction affects quality perception, user experience, and performance. The goal is to provide scientific foundations to technological and design solutions for haptic DMIs.

    Touch and audition are the main senses involved while playing traditional musical instruments, and they are key to performance control and expressivity. However, current digital musical instruments (DMIs) lack haptic feedback. Project AHMI (SNF 2014-2016) studied the role of auditory and haptic modalities in instrumental performance, achieving important results in audio-tactile perception, haptic interfaces, and contributing to establish Musical Haptics as an internationally recognized topic. A book entitled “Musical Haptics” is currently being edited by Dr. Stefano Papetti and will be published by Springer in 2018.

    This project continues the research set by AHMI, refining previous haptic musical interface prototypes (HSoundplane, VibroPiano, Touch-Box mkII) and investigating how haptic feedback in musical interaction affects subjective qualitative features (e.g., quality of musical instruments, user experience) and objective aspects related to performance (e.g., intonation, time accuracy).

    Details

    • Research Focus
      • FSP Technologie und Musikalische Praxis
    • Project Lead
      • Stefano Papetti (ICST)
    • Team
      • Martin Fröhlich (ICST)
      • Hanna Järveläinen (ICST)
    • Duration

      01.01. – 31.12.2017

    • Research Approaches
      • Applied research
      • Scientific research
    • Disciplines

      Design, Music, Transdisciplinary

    • Keywords

      Evaluation, Interaktive Systeme, Human-Computer Interaction, Audio-Haptic Feedback, Musical Interfaces, Sound, Performance

    Output

    • Aufsätze in Sammelbänden, Ausstellungskatalogen, Buchbeiträge

      Papetti, Stefano / Fröhlich, Martin / Fontana, Federico / Schiesser, Sébastien & Avanzini, Federico (2018): «Implementation and Characterization of Vibrotactile Interfaces». In: Papetti, Stefano & Saitis, Charalampos (Hg.): Musical Haptics. Springer Series on Touch and Haptic Systems. Cham: Springer Open, 257–282. Online unter: https://doi.org/10.5281/zenodo.3628523.

    • Aufsätze in Fachzeitschriften

      Papetti, Stefano / Järveläinen, Hanna & Fontana, Federico (2023): «Design and Assessment of Digital Musical Devices Yielding Vibrotactile Feedback». Arts. 12, 4. 1–25. Online unter: https://doi.org/10.3390/arts12040143.

    • Aufsätze in Fachzeitschriften

      Del Piccolo, Alan / Rocchesso, Davide & Papetti, Stefano (2019): «Path Following in Non-Visual Conditions». IEEE Transactions on Haptics. 12, 1. 56–67. Online unter: https://doi.org/10.5281/zenodo.4304318.

    • Aufsätze in Fachzeitschriften

      Fontana, Federico / Papetti, Stefano / Järveläinen, Hanna & Avanzini, Federico (2017): «Detection of keyboard vibrations and effects on perceived piano quality». The Journal of the Acoustical Society of America. 142, 5. 2953–2967. Online unter: https://doi.org/10.5281/zenodo.3676535.

    • Aufsätze in Fachzeitschriften

      Rocchesso, Davide / Delle Monache, Stefano & Papetti, Stefano (2016): «Multisensory texture exploration at the tip of the pen». International Journal of Human-Computer Studies. 85. 47–56. Online unter: https://doi.org/10.5281/zenodo.3648183.

    • Aufsätze in Tagungsakten (Vortrag, Keynote)

      Fontana, Federico / Avanzini, Federico & Papetti, Stefano (2018): «Evidence of Lateralization Cues in Grand and Upright Piano Sounds». Proceedings of the Sound and Music Computing Conference. Limassol, Cyprus: 80–84. Online unter: https://doi.org/10.5281/zenodo.3694958.

    • Herausgeberschaft

      Papetti, Stefano & Saitis, Charalampos (Hg.) (2018): Musical Haptics. Springer Series on Touch and Haptic Systems. Cham: Springer Open. Online unter: https://doi.org/10.5281/zenodo.3628467.

    • Audio-Datei

      Papetti, Stefano / Avanzini, Federico & Fontana, Federico (2018): «BiVib. Audio-Tactile Piano Sample Library». Online unter: https://doi.org/10.5281/zenodo.1213210.

    • Öffentliche Präsentationen

      Papetti, Stefano (2018): «Auditory-tactile modalities in everyday and musical interaction». Genova, Italy.

    • Andere aktive Teilnahmen (Podiumsteilnahme, Posterpräsentation etc.)

      Papetti, Stefano / Fröhlich, Martin (2018): «The TouchBox: A DIY haptic interface for finger-based interaction». Eurohaptics. 13.06.2018–16.06.2018. Pisa, Italy.

    • Medienresonanz

      Fischer, Roland (2017): «Vibrierendes Feedback». Horizonte – Das Schweizer Forschungsmagazin, 113.32–33. Besprechung von: Audio-Haptic modalities in Musical Interfaces. Papetti, Stefano / Fröhlich, Martin / Järveläinen, Hanna & Schiesser, Sébastien. Online unter: http://www.snf.ch/SiteCollectionDocuments/horizonte/Horizonte_gesamt/SNF_horizonte_113_de.pdf.