6533b832fe1ef96bd1299f1c

RESEARCH PRODUCT

Study of 3D sound for an audio-visual interaction in enriched virtual environment

subject

description

Most of the applications integrating 3D sound in virtual environment are limited to acoustic simulation. The objective of this thesis is to study the added value of 3D sound in the interaction with virtual environment. We developed an audio stimulation technique called "Artificial Spatial Audio Sensation: (ASAS)" based on the creation of audio effects. This technique conveys the sensations of spatialized sound that allows accurate sound source localization in azimuth and in elevation. In order to improve the localization time we also developed a model that integrates Head-Related Transfer Function (HRTF) with the ASAS technique. For the simulation of the depth of spatial sound sources, we developed a technique based on a combined model that integrates the intensity cue and the interaural time differences. The techniques developed in this thesis were applied for audio cueing in order to convey accurate spatial information in azimuth, elevation and depth. The combined model was applied in surgical simulation to assist the operator in the execution of the triangulation gesture. We conducted an experimental validation of this approach in terms of the criteria of manipulation performance and user's appreciation. The results obtained in this research are promising for the use of 3D sound to enrich the interaction in virtual environment.