Search results for "Sign language"
showing 10 items of 101 documents
Robust Hand Gestures Recognition Using a Deep CNN and Thermal Images
2021
Medical systems and assistive technologies, human-computer interaction, human-robot interaction, industrial automation, virtual environment control, sign language translation, crisis and disaster management, entertainment and computer games, and so on all use RGB cameras for hand gesture recognition. However, their performance is limited especially in low-light conditions. In this paper, we propose a robust hand gesture recognition system based on high-resolution thermal imaging that is light-independent. A dataset of 14,400 thermal hand gestures is constructed, separated into two color tones. We also propose using a deep CNN to classify high-resolution hand gestures accurately. The propose…
Estimating head pose and state of facial elements for sign language video
2014
In this work we present methods for automatic estimation of non-manual gestures in sign language videos. More specifically, we study the estimation of three head pose angles (yaw, pitch, roll) and the state of facial elements (eyebrow position, eye openness, and mouth state). This kind of estimation facilitates automatic annotation of sign language videos and promotes more prolific production of annotated sign language corpora. The proposed estimation methods are incorporated in our publicly available SLMotion software package for sign language video processing and analysis. Our method implements a model-based approach: for head pose we employ facial landmarks and skins masks as features, a…
A system for sign language sentence recognition based on common sense context
2005
The paper proposes a complete framework for sign language recognition that integrates common sense in order to deal with sentences. The proposed system is based on a cognitive architecture allows modeling and managing the knowledge of the recognition process in a simple and robust way. The final abstraction level of this architecture introduces the semantic context and the analysis of the correctness of a sentence given a sequence of recognized signs. Experimentations are presented using the Italian sign language (LIS), and shows that the system maintains the recognition rate high when set of sign grows, correcting erroneous recognized single sign using the context
Mutual intelligibility among the sign languages of Belgium and the Netherlands
2015
AbstractIn an exploratory study of mutual intelligibility between the sign languages of the northern part of Belgium (Flemish Sign Language, VGT), the southern part of Belgium (French Belgian Sign Language, LSFB), and the Netherlands (Sign Language of the Netherlands, NGT), we tested the comprehension of VGT by signers of LSFB and NGT. In order to measure the influence of iconic structures (classifier constructions and constructed action) that linguistic analyses have shown to be similar across different sign languages, two genres were compared: narrative and informative signing. To investigate the effect of the overlap between the spoken languages surrounding the Dutch and Flemish Deaf com…
Differentiation in language and gesture use during early bilingual development of hearing children of Deaf parents
2014
Hearing children of Deaf parents simultaneously acquire sign language and spoken language, which have many structural differences and represent two different modalities. We video-recorded eight children every six months between the ages of 12 and 24 months during three different play sessions: with their Deaf parent, with the Deaf parent and a hearing adult, and with a hearing adult alone. Additionally, we collected data on their vocabulary development in both sign language and spoken language. Children as young as 12 months old accommodated their language use according to the language(s) of their interlocutor(s). Additionally, the children used a manual modality that included gestures more…
The more you move, the more action you construct : a motion capture study on head and upper-torso movements in constructed action in Finnish Sign Lan…
2020
Abstract This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed action) in FinSL. Specifically, the paper evaluates the validity of two arguments concerning constructed action: that constructed action forms a continuum with regular narration, and that constructed action divides into three subtypes (i.e., overt, reduced, and subtle). The results presented in the paper support the first argument but not directly the second one. Because of the ambiguous position of reduced constructed action in between subtle and overt const…
Embodiment and American Sign Language
2016
Little is known about how individual signs that occur in naturally produced signed languages are recognized. Here we examine whether sign understanding may be grounded in sensorimotor properties by evaluating a signer’s ability to make lexical decisions to American Sign Language (ASL) signs that are articulated either congruent with or incongruent with the observer’s own handedness. Our results show little evidence for handedness congruency effects for native signers’ perception of ASL, however handedness congruency effects were seen in non-native late learners of ASL and hearing ASL-English bilinguals. The data are compatible with a theory of sign recognition that makes reference to intern…
Una prospettiva storica e pedagogica sulle Lingue dei Segni: riflessioni psicolinguistiche
2021
Da oltre 50 anni, da quando W. Stokoe negli anni '60 individuò in USA i parametri di articolazione delle lingue dei Segni (cfr. Stokoe, 1981), si assiste ad un sempre maggiore interesse nei confronti delle lingue visivo-gestuali delle comunità di sordi, grazie anche agli sviluppi nel campo della psicolinguistica, delle neuroscienze, e delle nuove tecnologie che consentono indagini sul linguaggio e sul funzionamento cerebrale impensabili sino a qualche tempo fa. Può forse sorprendere che, in una prospettiva storica, all'interno del dibattito linguistico-filosofico si può riscontrare un analogo interesse per i sordi e le loro forme di comunicazione soltanto nella seconda metà del sec. XVIII e…
First language acquisition in deaf children : with a special focus on the Norwegian educational system
2011
Masteroppgave i engelsk- Universitetet i Agder 2011
Design and Implementation of Deep Learning Based Contactless Authentication System Using Hand Gestures
2021
Hand gestures based sign language digits have several contactless applications. Applications include communication for impaired people, such as elderly and disabled people, health-care applications, automotive user interfaces, and security and surveillance. This work presents the design and implementation of a complete end-to-end deep learning based edge computing system that can verify a user contactlessly using &lsquo