6533b82ffe1ef96bd12951a8

RESEARCH PRODUCT

Body Gestures and Spoken Sentences: A Novel Approach for Revealing User’s Emotions

Antonio GentileGiovanni PilatoFabrizio MilazzoSalvatore SorceVito GentileAgnese Augello

subject

0209 industrial biotechnologyComputer scienceSpeech recognitionGesture Recognition02 engineering and technologycomputer.software_genreEmotion Recognition Gesture Recognition Sentiment AnalysisNonverbal communication020901 industrial engineering & automationSentiment Analysis0202 electrical engineering electronic engineering information engineeringEmotion recognitionSettore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniFacial expressionSettore INF/01 - Informaticabusiness.industry020207 software engineeringGesture recognitionEmotion RecognitionArtificial intelligencebusinesscomputerSentenceNatural language processingMeaning (linguistics)Gesture

description

In the last decade, there has been a growing interest in emotion analysis research, which has been applied in several areas of computer science. Many authors have con- tributed to the development of emotion recognition algorithms, considering textual or non verbal data as input, such as facial expressions, gestures or, in the case of multi-modal emotion recognition, a combination of them. In this paper, we describe a method to detect emotions from gestures using the skeletal data obtained from Kinect-like devices as input, as well as a textual description of their meaning. The experimental results show that the correlation existing between body movements and spoken user sentence(s) can be used to reveal user's emotions from gestures.

yearjournalcountryeditionlanguage
2017-03-012017 IEEE 11th International Conference on Semantic Computing (ICSC)
https://doi.org/10.1109/icsc.2017.14