Project by Carlo Barone and Guilherme Diegoli Neto 

Abstract We took inspiration from an audio-based installation to design a virtual installation using virtual reality software and experiment with sound interaction within this medium. While plenty of research exists on the topics of use of au- dio in virtual reality and use of body motion to modulate sounds, not much can be found about the combination of these two aspects, via the use of a head-mounted display paired with motion controllers. We designed a prototype in which the user can create their own installation and in- teract with it, and mapped most of the available interaction to sound modulations such as pitch and gain. Audio was also spatialized based on the position of the objects and the head. While we were not able to test the prototype exten- sively with users, we found that it enabled for unexpected combinations of different interactions, and that audio spa- tialization plays a big part in how this virtual environment can be perceived and interacted with. While the prototype might not be a substitute for a physical installation, it nev- ertheless highlighted the novel ways in which audio can be interacted with in VR.