Search results for "Gesture"
showing 10 items of 186 documents
Design and Investigation of a Touch Gesture for Dividing in a Virtual Manipulative Model for Equation-solving
2020
AbstractPhysical models for equation solving typically lack feedback regarding their appropriate use. Such feedback is possible in virtual environments and could be implemented in hybrid models. Based on an epistemological analysis, this article presents a touch gesture as a way for users to signal they want to divide both sides of an equation and a design for feedback on the use of this so-called ‘division gesture’. The design is investigated by contrasting a case study, in which students used an app with the division gesture, with a preparatory study where students had to perform corresponding actions on physical manipulatives. This investigation revealed insight into feedback functions, …
Developing hand-worn input and haptic support for real-world target finding
2019
Locating places in cities is typically facilitated by handheld mobile devices, which draw the visual attention of the user on the screen of the device instead of the surroundings. In this research, we aim at strengthening the connection between people and their surroundings through enabling mid-air gestural interaction with real-world landmarks and delivering information through audio to retain users' visual attention on the scene. Recent research on gesture-based and haptic techniques for such purposes has mainly considered handheld devices that eventually direct users' attention back to the devices. We contribute a hand-worn, mid-air gestural interaction design with directional vibrotacti…
The body talks: Sensorimotor communication and its brain and kinematic signatures
2019
Human communication is a traditional topic of research in many disciplines such as psychology, linguistics and philosophy, all of which mainly focused on language, gestures and deictics. However, these do not constitute the sole channels of communication, especially during online social interaction, where instead an additional critical role may be played by sensorimotor communication (SMC). SMC refers here to (often subtle) communicative signals embedded within pragmatic actions - for example, a soccer player carving his body movements in ways that inform a partner about his intention, or to feint an adversary; or the many ways we offer a glass of wine, rudely or politely. SMC is a natural …
Robust Hand Gestures Recognition Using a Deep CNN and Thermal Images
2021
Medical systems and assistive technologies, human-computer interaction, human-robot interaction, industrial automation, virtual environment control, sign language translation, crisis and disaster management, entertainment and computer games, and so on all use RGB cameras for hand gesture recognition. However, their performance is limited especially in low-light conditions. In this paper, we propose a robust hand gesture recognition system based on high-resolution thermal imaging that is light-independent. A dataset of 14,400 thermal hand gestures is constructed, separated into two color tones. We also propose using a deep CNN to classify high-resolution hand gestures accurately. The propose…
Gesture Modeling by Hanklet-Based Hidden Markov Model
2015
In this paper we propose a novel approach for gesture modeling. We aim at decomposing a gesture into sub-trajectories that are the output of a sequence of atomic linear time invariant (LTI) systems, and we use a Hidden Markov Model to model the transitions from the LTI system to another. For this purpose, we represent the human body motion in a temporal window as a set of body joint trajectories that we assume are the output of an LTI system. We describe the set of trajectories in a temporal window by the corresponding Hankel matrix (Hanklet), which embeds the observability matrix of the LTI system that produced it. We train a set of HMMs (one for each gesture class) with a discriminative a…
Discussions of Part I Chapters
2016
This chapter is an opportunity for one of the authors of this book to question the other two authors in the light of issues raised in Chaps. 2– 5. It constitutes both a follow-up to discussions between authors which occurred over the writing process, and emergent issues—new discussions once the book was almost complete. Some fundamental issues are addressed, about the birth of mathematics (and its deep links with the birth of writing), the relationships between mathematics and other sciences, the interactions between conjecture and proof, and the role of visualisation and of gestures. The text is kept short in order to provoke the readers to reflect on these issues rather than for the autho…
Categories, Musical Instruments, and Drawings: A Unification Dream
2019
The mathematical formalism of category theory allows to investigate musical structures at both low and high levels, performance practice (with musical gestures) and music analysis. Mathematical formalism can also be used to connect music with other disciplines such as visual arts. In our analysis, we extend former studies on category theory applied to musical gestures, including musical instruments and playing techniques. Some basic concepts of categories may help navigate within the complexity of several branches of contemporary music research, giving it a unitarian character. Such a 'unification dream,' that we can call 'cARTegory theory,' also includes metaphorical references to topos th…
The Interplay Between Gesture and Discourse as Mediating Devices in Collaborative Mathematical Reasoning:A Multimodal Approach
2008
This article aims to identify the mathematical reasoning strategies expressed through gestures and speech used by two groups of sixth-grade pupils when solving a task related to the transition between two semiotic representations: figure and Cartesian diagram. The article also identifies the difficulties the pupils meet in the solution process. The analyses of the group dialogues focus particularly on the gesture dimension of deixis. The pupils in both groups have used the following deictic gestures: pointing, held-point, linear point-slide, and circular point-slide in their solution process, while repeated pointing has been identified only in one of the groups. These pointing gestures are …
Differentiation in language and gesture use during early bilingual development of hearing children of Deaf parents
2014
Hearing children of Deaf parents simultaneously acquire sign language and spoken language, which have many structural differences and represent two different modalities. We video-recorded eight children every six months between the ages of 12 and 24 months during three different play sessions: with their Deaf parent, with the Deaf parent and a hearing adult, and with a hearing adult alone. Additionally, we collected data on their vocabulary development in both sign language and spoken language. Children as young as 12 months old accommodated their language use according to the language(s) of their interlocutor(s). Additionally, the children used a manual modality that included gestures more…