6533b82afe1ef96bd128c1f0

RESEARCH PRODUCT

Sensor Fusion Localization and Navigation for Visually Impaired People

Ilenia TinnirelloFederica InderstLaura GiarreDaniele CroceFederica PascucciGiovanni Ettore Galioto

subject

Control and OptimizationExploitSettore ING-INF/03 - TelecomunicazioniComputer sciencebusiness.industry05 social sciencesCyber-physical system020206 networking & telecommunicationsTracking system02 engineering and technologySensor fusionColoredControl and Systems EngineeringInertial measurement unit0202 electrical engineering electronic engineering information engineering0501 psychology and cognitive sciencesComputer visionArtificial intelligencebusinessJoint (audio engineering)Image resolution050107 human factors

description

In this paper, we present an innovative cyber physical system for indoor and outdoor localization and navigation, based on the joint utilization of dead-reckoning and computer vision techniques on a smartphone-centric tracking system. The system is explicitly designed for visually impaired people, but it can be easily generalized to other users, and it is built under the assumption that special reference signals, such as colored tapes, painted lines, or tactile paving, are deployed in the environment for guiding visually impaired users along pre-defined paths. Differently from previous works on localization, which are focused only on the utilization of inertial sensors integrated into the smartphones, we exploit the smartphone camera as an additional sensor that, on one side, can help the visually impaired user to identify the paths and, on the other side, can provide direction estimates to the tracking system. We demonstrate the effectiveness of our approach, by means of experimental tests performed in a real outdoor installation and in a controlled indoor environment.

https://doi.org/10.23919/ecc.2018.8550373