Touchless gestural interfaces for networked public displays
In the near future, we can easily imagine a significant increment in diffusion of networked public displays, as well as novel interaction modalities used in their applications. In the following, we present two of the main challenges related to networked displays we are dealing with, with a particular focus on touchless gestural interfaces: overcoming interaction blindness (i.e. enable users to immediately guess the interactivity of the display, and the gestural nature of it) and performing evaluations in-the-wild (i.e. outside any controlled environment).
Exploring usability and accessibility of avatar-based touchless gestural interfaces for autistic people
Many prior works investigated the potential of pervasive technologies and interactive applications to increase access capabilities to digital content for people with disability, particularly Neuro-Developmental Disorders (NDDs). In this paper, we present an exploratory study aimed at understanding if an avatar-based touchless gestural interface is able to foster interest towards digital representations of artworks, e.g. paintings or sculptures usually exhibited in museums, and to make them more accessible for such people. In particular, the study involved three autistic people and a therapist, and allowed us to report the potential of an avatar to communicate the interactivity and stimulate…
A Novel Visual Interface to Foster Innovation in Mechanical Engineering and Protect from Patent Infringement
One of the main time and money consuming tasks in the design of industrial devices and parts is the checking of possible patent infringements. Indeed, the great number of documents to be mined and the wide variety of technical language used to describe inventions are reasons why considerable amounts of time may be needed. On the other hand, the early detection of a possible patent conflict, in addition to reducing the risk of legal disputes, could stimulate a designers' creativity to overcome similarities in overlapping patents. For this reason, there are a lot of existing patent analysis systems, each with its own features and access modes. We have designed a visual interface providing an …
Touchless Interfaces For Public Displays
Public displays have lately become ubiquitous thanks to the decreasing cost of such technology and public policies supporting the development of smart cities. Depending on form factor, those displays might use touchless gestural interfaces that therefore are becoming more often the subject of public and private research. In this paper, we focus on touchless interactions with situated public displays, and introduce a pilot study on comparing two interfaces: an interface based on the Microsoft Human Interface Guidelines (HIG), a de facto standard in the field, and a novel interface, designed by us. Differently from the HIG-based one, our interface displays an avatar, which does not require an…
A touchless gestural system for extended information access within a campus
In the last two decades, we have witnessed a growing spread of touchless interfaces, facilitated by higher performances of computational systems, as well as the increased availability of cheaper sensors and devices. Putting the focus on gestural input, several researchers and designers used Kinect-like devices to implement touchless gestural interfaces. The latter extends the possible deployments and usage of public interactive displays. For example, wall-sized displays may become interactive even if they are unreachable by touch. Moreover, billboard-sized displays may be placed in safe cases to avoid vandalism, while still maintaining their interactivity. Finally, people with temporary or …
Human-to-Human Interaction: The Killer Application of Ubiquitous Computing?
Twenty-five years past the Weiser’s vision of Ubiquitous Computing, and there is not a clear understanding of what is or is not a pervasive system. Due to the loose boundaries of such paradigm, almost any kind of remotely ac-cessible networked system is classified as a pervasive system. We think that that is mainly due to the lack of killer applications that could make this vi-sion clearer. Actually, we think that the most promising killer application is already here, but we are so used to it that we do not see it, as a perfect fitting of the Weiser’s vision: the Human-to-Human Interaction mediated by com-puters.
Investigating how user avatar in touchless interfaces affects perceived cognitive load and two-handed interactions
In recent years, touchless-enabling technologies have been more and more adopted for providing public displays with gestural interactivity. This has led to the need for novel visual interfaces aimed at solving issues such as communicating interactivity to users, as well as supporting immediate usability and "natural" interactions. In this paper, we focus our investigation on a visual interface based only on the use of in-air direct manipulations. Our study aims at evaluating whether and how the presence of an Avatar that replays user's movements may decrease the perceived cognitive workload during interactions. Moreover, we conducted a brief evaluation of the relationship between the presen…
Child–display interaction:Lessons learned on touchless avatar-based large display interfaces
AbstractDuring the last decade, touchless gestural interfaces have been widely studied as one of the most promising interaction paradigms in the context of pervasive displays. In particular, avatars and silhouettes have proved to be effective in making the touchless capacity of displays self-evident. In this paper, we focus on a child–display interaction approach to avatar-based touchless gestural interfaces. We believe that large displays offer an opportunity to stimulate children’s experiences and engagement; for instance, learning about art is very engaging for children but can bring a number of challenges. Our study aims to contribute to the literature on both pervasive displays and chi…
Designing Touchless Gestural Interactions for Public Displays In-the-Wild
Public displays, typically equipped with touchscreens, are used for interactions in public spaces, such as streets or fairs. Currently low-cost visual sensing technologies, such as Kinect-like devices and high quality cameras, allow to easily implement touchless interfaces. Nevertheless, the arising interactions have not yet been fully investigated for public displays in-the-wild (i.e. in appropriate social contexts where public displays are typically deployed). Different audiences, cultures and social settings strongly affect users and their interactions. Besides gestures for public displays must be guessable to be easy to use for a wide audience. Issues like these could be solved with use…
Design for invention: a framework for identifying emerging design–prior art conflict
The increasing complexity of patented mechanical designs means that their novelty and inventive steps increasingly rely on interacting geometric features and how they contribute to device functions. These features and interactions are normally incorporated in patents through clear patent claims. However, patents can be difficult to interpret and understand for designers due to their legal terminologies. This suggests there is a need for greater awareness of relevant prior art amongst designers in terms of avoiding potential conflict. This paper presents a framework that helps designers obtain insight on relevant prior art and enables emerging design–prior art comparison. The framework mainl…
Evaluation of a Visual Tool for Early Patent Infringement Detection During Design
Patent infringement detection usually implies research among documents in different forms, in both natural and unstructured language, often involving a lot of human resources and time. In order to ease this patent check process, we previously presented a visual tool to be used by designers themselves at any stage of the design process, providing them with useful and reliable information for deciding whether to steer their design away from potential patent infringements. In this work, we report on a usability study carried out on such a tool with 21 professional designers from industry in the field of mechanical engineering. The outcome of our study shows that our tool is very well accepted …
Predicting mid-air gestural interaction with public displays based on audience behaviour
Abstract Knowledge about the expected interaction duration and expected distance from which users will interact with public displays can be useful in many ways. For example, knowing upfront that a certain setup will lead to shorter interactions can nudge space owners to alter the setup. If a system can predict that incoming users will interact at a long distance for a short amount of time, it can accordingly show shorter versions of content (e.g., videos/advertisements) and employ at-a-distance interaction modalities (e.g., mid-air gestures). In this work, we propose a method to build models for predicting users’ interaction duration and distance in public display environments, focusing on …
Child-display interaction: Exploring avatar-based touchless gestural interfaces
During the last decade, touchless gestural interfaces have been widely studied as one of the most promising interaction paradigms in the context of pervasive displays. In particular, avatars and silhouettes have been proved to be effective in communicating the touchless gestural interactivity supported by displays. In the paper, we take a child-display interaction perspective by exploring avatar-based touchless gestural interfaces. We believe that large displays offer an opportunity to stimulate child experience and engagement, for instance when learning about art, as well as bringing a number of challenges. The purpose of this study is twofold: 1) identifying the relevant aspects of childr…