0000000000211209

AUTHOR

Yi-ta Hsieh

showing 3 related works from this author

Interweaving visual and audio-haptic augmented reality for urban exploration

2018

While ordinary touchscreen-based interfaces on urban explorer applications draw much of a user's attention onto the screen, visual and audio-haptic augmented reality interfaces have emerged as the two main streams for enabling direct focus on the surroundings. However, neither interface alone satisfies users in the highly dynamic urban environment. This research investigates how the two complementary augmentation can coexist on one system and how people adapt to the situation by selecting the more suitable interface. A prototype was deployed in a field experiment in which participants explored points of interest in an urban environment with both interfaces. The engagement with the surroundi…

Point of interestComputer scienceInterface (computing)02 engineering and technologyAugmented realitylaw.inventionMultimodal interactionTouchscreenlawHuman–computer interaction11. SustainabilitySituated0202 electrical engineering electronic engineering information engineeringAudio-haptic interfaceUrban exploration0501 psychology and cognitive sciences050107 human factorsHaptic technologyta113Settore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniFocus (computing)Point (typography)Settore INF/01 - Informatica05 social sciences020201 artificial intelligence & image processingAugmented reality
researchProduct

A wearable multimodal interface for exploring urban points of interest

2015

Locating points of interest (POIs) in cities is typically facilitated by visual aids such as paper maps, brochures, and mobile applications. However, these techniques require visual attention, which ideally should be on the surroundings. Non-visual techniques for navigating towards specific POIs typically lack support for free exploration of the city or more detailed guidance. To overcome these issues, we propose a multimodal, wearable system for alerting the user of nearby recommended POIs. The system, built around a tactile glove, provides audio-tactile cues when a new POI is in the vicinity, and more detailed information and guidance if the user expresses interest in this POI. We evaluat…

Point of interestComputer scienceInterface (computing)Wearable computer02 engineering and technologycomputer.software_genreAuditory iconsField (computer science)Multimodal interactionMultimodal interactionHuman–computer interaction11. SustainabilityWearable computing0202 electrical engineering electronic engineering information engineeringVisual attention0501 psychology and cognitive sciencesBaseline (configuration management)050107 human factorsta113Settore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniMultimediaSettore INF/01 - InformaticaTactile feedback05 social sciences020207 software engineeringAuditory iconCultural heritagecomputer
researchProduct

Developing hand-worn input and haptic support for real-world target finding

2019

Locating places in cities is typically facilitated by handheld mobile devices, which draw the visual attention of the user on the screen of the device instead of the surroundings. In this research, we aim at strengthening the connection between people and their surroundings through enabling mid-air gestural interaction with real-world landmarks and delivering information through audio to retain users' visual attention on the scene. Recent research on gesture-based and haptic techniques for such purposes has mainly considered handheld devices that eventually direct users' attention back to the devices. We contribute a hand-worn, mid-air gestural interaction design with directional vibrotacti…

Computer scienceNovel interaction paradigmMobile computingAugmented reality02 engineering and technologyInteraction designManagement Science and Operations ResearchGestural inputHuman–computer interactionNovel interaction paradigms020204 information systems0202 electrical engineering electronic engineering information engineeringAuditory feedback; Augmented reality; Gestural input; Haptic devices; Novel interaction paradigms; Pointing; Ubiquitous and mobile computing design and evaluationHaptic devicesHaptic technologySettore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniAuditory feedbackHaptic deviceSettore INF/01 - InformaticaUbiquitous and mobile computing design and evaluation020206 networking & telecommunicationsInteraction techniquePointingComputer Science ApplicationsHardware and ArchitectureAugmented realityMobile deviceAuditory feedbackGesturePersonal and Ubiquitous Computing
researchProduct