Home
Home
Home
Home
    • DE
    • EN
  • Menu
  1. Studyprojects
  2. /

Dialog - A Sonic Encounter with a Large Language Model in VR

Masterarbeit und Thesis Jonas Füllemann, 2025

Master Komposition/Theorie - Sound Design

RNBO Patch for Embedding Bells, Jonas Füllemann, Jonas Füllemann

An interactive sound experience with a language model in Virtual Reality. It maps the inner workings of the AI, as well as the user's physical movements and behavior, onto sound.

Spoken words are transcribed and sent to a server, where the AI generates an answer. The hidden data behind the model's "thoughts", including its internal processing states, is sent back to the WebXR or Android interface. There, custom-built audio software transforms this data into sound in real-time.

Details

  • Discipline

    Design

  • Project Type

    Abschlussarbeit

  • Field of Study

    Master Komposition/Theorie - Sound Design

  • Authors

    Jonas Füllemann

  • Date

    25.09.2025

  • Links
    https://www.jrfsound.ch/dialog
  • 2025_Dialog_Fuellemann_0918.pdf