6533b853fe1ef96bd12ac218
RESEARCH PRODUCT
Multisensory texture exploration at the tip of the pen
Stefano PapettiS. Delle MonacheDavide Rocchessosubject
3304Computer scienceRealization (linguistics)ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONHuman Factors and ErgonomicsMultisensory Textures02 engineering and technologyTexture (music)Multisensory textureEducationEngineering (all)Sonic Interaction DesignSonic interaction design0202 electrical engineering electronic engineering information engineeringComputer visionEngineering(all)Pen-based interaction; Pseudo-haptics; Multisensory textures; Sonic interaction designPseudo-hapticComputingMethodologies_COMPUTERGRAPHICSSettore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniSettore INF/01 - Informaticabusiness.industryMovement (music)Work (physics)General Engineering020207 software engineeringMultisensory textures; Pen-based interaction; Pseudo-haptics; Sonic interaction design; Human Factors and Ergonomics; Software; 3304; Engineering (all); Human-Computer Interaction; Hardware and ArchitectureHuman Factors and ErgonomicPseudo-hapticsHuman-Computer InteractionPen-based InteractionHardware and Architecture020201 artificial intelligence & image processingArtificial intelligencebusinessStylusSoftwareGraphics tabletGesturedescription
A tool for the multisensory stylus-based exploration of virtual textures was used to investigate how different feedback modalities (static or dynamically deformed images, vibration, sound) affect exploratory gestures. To this end, we ran an experiment where participants had to steer a path with the stylus through a curved corridor on the surface of a graphic tablet/display, and we measured steering time, dispersion of trajectories, and applied force. Despite the variety of subjective impressions elicited by the different feedback conditions, we found that only nonvisual feedback induced significant variations in trajectories and an increase in movement time. In a post-experiment, using a paper-and-wood physical realization of the same texture, we recorded a variety of gestural behaviors markedly different from those found with the virtual texture. With the physical setup, movement time was shorter and texture-dependent lateral accelerations could be observed. This work highlights the limits of multisensory pseudo-haptic techniques in the exploration of surface textures.
year | journal | country | edition | language |
---|---|---|---|---|
2016-01-01 |