Virtual reality (VR) can be a strong research tool in audio-visual (AV) experiments. It allows us to investigate AV integration in complex and realistic settings. Here, using a VR setup-up in combination with a loudspeaker array, 16 normal-hearing participants were tested on their sound localization abilities. The virtual environment consisted of a 1:1 model of the experimental environment except with the loudspeaker array replaced by a ring. This ring indicated the height, but not the position of the loudspeakers. The visual component of the stimuli consisted of a ball falling and then bouncing once on the ring after which it disappeared. As the ball collided with the ring, an impact sound was played from a loudspeaker. Participants were asked to indicate the apparent sound origin, for both congruent and incongruent visual and audio spatial positions ranging from -30 to 30 degrees. The VR visual stimuli in combination with real auditory stimuli were capable of inducing AV integration. The range of this integration extended, for several participants, over large ranges of AV disparity compared to some earlier studies.


    Access

    Download


    Export, share and cite



    Title :

    Audio-visual sound localization in virtual reality


    Contributors:

    Publication date :

    2020-01-01


    Remarks:

    Huisman , T , Piechowiak , T , Dau , T & MacDonald , E 2020 , Audio-visual sound localization in virtual reality . in Proceedings of the International Symposium on Auditory and Audiological Research : Auditory Learning in Biological and Artificial Systems . vol. 7 , The Danavox Jubilee Foundation , Proceedings of the International Symposium on Auditory and Audiological Research , vol. 7 , pp. 349-356 , International Symposium on Auditory and Audiological Research , Nyborg , Denmark , 21/08/2020 .


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    150 / 629



    Sound reproduction methods for source localization in virtual-reality-based automotive simulators.

    Jo, Eun Soo / Park, Dong Chul / Gil Carvajal, Juan Camilo et al. | BASE | 2022

    Free access

    Sound Distance Localization Using Virtual Environment

    Ohkura, M. / Yanagida, Y. / Tachi, S. | British Library Online Contents | 1995


    Virtual Reality of Sound Generated from Vibrating Structures

    Kim, S. J. / Song, J. Y. / American Institute of Aeronautics and Astronautics et al. | British Library Conference Proceedings | 2000