6533b837fe1ef96bd12a32e9

RESEARCH PRODUCT

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

Vicent Girbés-juanVinicius SchettinoLuis GraciaJ. Ernesto SolanesYiannis DemirisJosep Tornero

subject

Human-Computer InteractionTecnologiaSignal Processing

description

AbstractHigh dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method.

https://doi.org/10.1007/s12193-021-00386-8