6533b821fe1ef96bd127c272

RESEARCH PRODUCT

A Low-Cost Multi-Modal Auditory-Visual-Tactile Framework for Remote Touch

Claudio PacchierottiFilippo Sanfilippo

subject

Computer sciencebusiness.industrymedia_common.quotation_subject010401 analytical chemistryIllusion02 engineering and technologyTechnology readiness levelVirtual realityModular design021001 nanoscience & nanotechnology01 natural sciences0104 chemical sciencesVisualizationHuman-Computer InteractionSoftwareModalHuman–computer interaction[INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]0210 nano-technologybusinessComputingMilieux_MISCELLANEOUSWearable HapticsHaptic technologymedia_commonMultimodality

description

International audience; Haptic technology for human augmentation provides gains in ability for different applications, whether the aim is to enhance "disabilities" to "abilities", or "abilities" to "super-abilities". Commercially-available devices are generally expensive and tailored to specific applications and hardware. To give researchers a haptic feedback system that is economical, customisable, and fast to fabricate, our group developed a low-cost immersive haptic, audio, and visual experience built by using off-the-shelf (COTS) components. It is composed of a vibrotactile glove, a Leap Motion sensor, and an head-mounted display, integrated together to provide compelling immersive sensations. This paper proposes a higher technology readiness level (TRL) for the system to make it modular and reliable. To demonstrate its potential, we present two human subject studies in Virtual Reality. They evaluate the capability of the system in providing (i) guidance during simulated drone operations, and (ii) contact haptic feedback during virtual objects interaction. Results prove that the proposed haptic-enabled framework improves the performance and illusion of presence.

https://hal.inria.fr/hal-02507203/file/a-low-cost-multi-modal-auditory-visual-tactile-framework-for-remote-touch.pdf