6533b860fe1ef96bd12c325b

RESEARCH PRODUCT

Towards EEG-Based Haptic Interaction within Virtual Environments

Stanley TarngFrederic MerienneDeng WangYaoping Hu

subject

medicine.medical_specialtySynthèse d'image et réalité virtuelle [Informatique]Computer science[INFO.INFO-GR] Computer Science [cs]/Graphics [cs.GR]02 engineering and technologyAudiologyElectroencephalographyVirtual realityVibrationEvent-related potential (ERP)Virtual reality0202 electrical engineering electronic engineering information engineeringmedicine[INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]Electroencephalography (EEG)ForceHaptic technologyHaptic interactionmedicine.diagnostic_test020207 software engineeringHaptic stimuli[INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR]Interface homme-machine [Informatique]020201 artificial intelligence & image processing[INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC]

description

International audience; Current virtual environments (VE) enable perceiving haptic stimuli to facilitate 3D user interaction, but lack brain-interfacial contents. Using electroencephalography (EEG), we undertook a feasibility study on exploring event-related potential (ERP) patterns of the user's brain responses during haptic interaction within a VE. The interaction was flying a virtual drone along a curved transmission line to detect defects under the stimuli (e.g., force increase and/or vibrotactile cues). We found that there were variations in the peak amplitudes and latencies (as ERP patterns) of the responses at about 200 ms post the onset of the stimuli. The largest negative peak occurred during 200~400 ms after the onset in all vibration-related blocks. Moreover, the amplitudes and latencies of the peak were differentiable among the vibration-related blocks. These findings imply feasible decoding of the brain responses during haptic interaction within VEs.

yearjournalcountryeditionlanguage
2019-03-23
https://hal.science/hal-02332418