6533b7ddfe1ef96bd1274b02
RESEARCH PRODUCT
A framework for sign language sentence recognition by common sense context
Salvatore GaglioIgnazio InfantinoRiccardo Rizzosubject
PhraseItalian Sign LanguageComputer scienceSpeech recognitionNatural language interfaceneural networks.Context (language use)Image motion analysiSign languagecomputer.software_genreimage motion analysisKnowledge-based systemsElectrical and Electronic EngineeringCommonsense reasoningbusiness.industryCommonsense reasoningnatural language interfaceslanguage.human_languageComputer Science ApplicationsHuman-Computer InteractionControl and Systems EngineeringGesture recognitionlanguageArtificial intelligencebusinesscomputerSoftwareSentenceNatural languageNatural language processingNeural networksInformation Systemsdescription
This correspondence proposes a complete framework for sign language recognition that integrates a commonsense engine in order to deal with sentence recognition. The proposed system is based on a multilevel architecture that allows modeling and managing of the knowledge of the recognition process in a simple and robust way. The final abstraction level of this architecture introduces the semantic context and the analysis of the correctness of a sentence given in a sequence of recognized signs. Experimentations are presented using a set of signs from the Italian sign language (LIS) for domotic applications. The implemented system maintains a high recognition rate when the set of signs grows, correcting erroneously recognized single signs using the sentence context.
| year | journal | country | edition | language |
|---|---|---|---|---|
| 2007-09-01 |