Search results for "Gestures"
showing 10 items of 43 documents
A musical reading of a contemporary installation and back: mathematical investigations of patterns in Qwalala
2021
Mathematical music theory helps us investigate musical compositions in mathematical terms. Some hints can be extended towards the visual arts. Mathematical approaches can also help formalize a "translation" from the visual domain to the auditory one and vice versa. Thus, a visual artwork can be mathematically investigated, then translated into music. The final, refined musical rendition can be compared to the initial visual idea. Can an artistic idea be preserved through these changes of media? Can a non-trivial pattern be envisaged in an artwork, and then still be identified after the change of medium? Here, we consider a contemporary installation and an ensemble musical piece derived from…
Touch or touchless?:Evaluating usability of interactive displays for persons with autistic spectrum disorders
2019
Interactive public displays have been exploited and studied for engaging interaction in several previous studies. In this context, applications have been focused on supporting learning or entertainment activities, specifically designed for people with special needs. This includes, for example, those with Autism Spectrum Disorders (ASD). In this paper, we present a comparison study aimed at understanding the difference in terms of usability, effectiveness, and enjoyment perceived by users with ASD between two interaction modalities usually supported by interactive displays: touch-based and touchless gestural interaction. We present the outcomes of a within-subject setup involving 8 ASD users…
The body talks: Sensorimotor communication and its brain and kinematic signatures
2019
Human communication is a traditional topic of research in many disciplines such as psychology, linguistics and philosophy, all of which mainly focused on language, gestures and deictics. However, these do not constitute the sole channels of communication, especially during online social interaction, where instead an additional critical role may be played by sensorimotor communication (SMC). SMC refers here to (often subtle) communicative signals embedded within pragmatic actions - for example, a soccer player carving his body movements in ways that inform a partner about his intention, or to feint an adversary; or the many ways we offer a glass of wine, rudely or politely. SMC is a natural …
Facilitating joint attention with salient pointing in interactions involving children with autism spectrum disorder
2016
Children with autism spectrum disorder (ASD) reportedly have difficulties in responding to bids for joint attention, notably in following pointing gestures. Previous studies have predominantly built on structured observation measures and predefined coding categories to measure children’s responsiveness to gestures. However, how these gestures are designed and what detailed interactional work they can accomplish have received less attention. In this paper, we use a multimodal approach to conversation analysis (CA) to investigate how educators design their use of pointing in interactions involving school-aged children with ASD or autistic features. The analysis shows that pointing had specifi…
Diagrammatic Gestures. Cognition, Mathematics, and Semiotics.
2021
here are words having an extraordinary evocative power. This is precisely the case of “Diagram” and “Gesture”. The frst term covers an interconnected network of concepts like “graph”, “schema”, “form”, “model”, “arrow”, and so on... And the same can be said of the second one: just think, for example, of the ideas of “movement”, “bodily action”, “practical activity” or, more generally, of “doing”. Accounting for them has been, over the last 50 years, the aim of signifcant portions of the work conduction in philosophy (Deleuze, Foucault, Merleau-Ponty), mathematics (Grothendieck, Lawvere, Thom), semiotics (Peirce), and theoretical linguistics (Culioli, Langacker, Pottier). The present issue a…
Design and Implementation of Deep Learning Based Contactless Authentication System Using Hand Gestures
2021
Hand gestures based sign language digits have several contactless applications. Applications include communication for impaired people, such as elderly and disabled people, health-care applications, automotive user interfaces, and security and surveillance. This work presents the design and implementation of a complete end-to-end deep learning based edge computing system that can verify a user contactlessly using &lsquo
GESTURES AS A COMMUNICATION FEATURE IN CHILDREN WITH DEVELOPMENTAL LANGUAGE DISORDER
2019
Gestures as non-verbal communication allow us to express our attitude, emotional state, and it functions unconsciously. The verbal communication appears in the life of a child about 2 years of age and gradually replaces the non-verbal communication. However, children with DLD (Developmental Language Disorder) at the age of 3 and more do not speak or speak using separate sounds and combinations of sounds in their speech and use gestures broadly; it helps them to communicate with others. The aim of the article is to explore what kind of gestures as non-verbal communication are used by children with DLD in order to communicate with peers and adults. Based on the scientific literature of the re…
Print and online newspapers as material artefacts
2014
Traditional newspaper journalism is in a state of crisis and there have been several attempts to overcome this. Many discourses have reiterated the triumphal march of a digital revolution in newspaper journalism and anticipated the end of the print newspaper. This moment calls for an in-depth analysis of reader habits of news consumption and use in order to understand the audiences for journalistic output and their relationship with the journalistic objects. In this study, we adopt a multi-method approach, integrating (1) qualitative content analysis of student essays dealing with the physicality of printed and online newspapers, (2) ethnographic observation of the use practices of readers…
Proximal and distal. Rethinking linguistic form and use for clinical purposes.
2010
With clinical purposes in mind, a review of the proximal/distal opposition is carried out in order to define a universal parameter of variability in semiotic procedures. By taking into consideration different-although notionally inter-related-senses of the proximal/distal opposition, a cluster of semiotic properties is proposed, which initially permits one to characterize dimensions of variability in the form and use of gestures. The subsequent and central aim of this paper is, however, to demonstrate that the same, or homologous, properties can also serve to characterize variability in the use of language, by assuming a basic connection between gesturing and linguistic behaviour. The main …
Early communicative gestures and play as predictors of language development in children born with and without family risk for dyslexia
2014
The present study investigated early communicative gestures, play, and language skills in children born with family risk for dyslexia (FR) and a control group of children without this inheritable risk at ages 12, 15, 18, and 24 months. Participants were drawn from the Tromsø Longitudinal study of Dyslexia (TLD) which follows children's cognitive and language development from age 12 months through Grade 2 in order to identify early markers of developmental dyslexia. Results showed that symbolic play and parent reported play at age 12 months and communicative gestures at age 15 months explained 61% of the variance in productive language at 24 months in the FR group. These early nonlinguistic …