This project delves into cross-modal methodologies linking video and live mixed music, with a specific emphasis on sensory substitution algorithms. Building upon recent multimedia compositions, where video soundscapes are substituted with original mixed music, the objective is to investigate techniques for conveying sensory information across modalities. Key inquiries revolve around the identification of parameters for navigating sound databases and the reimagining of classical sound paradigms towards a post-instrumental framework.  

The research unfolds methodologically through literature review, dataset collection, algorithmic development, experimentation, and practical application in multimedia composition. Collaboration with mentors and experts at ICST is anticipated to refine methods and elevate artistic outcomes, fostering an environment conducive to interdisciplinary exploration and creative evolution.