6533b7d6fe1ef96bd1266687
RESEARCH PRODUCT
Embodied responses to musical experience detected by human bio-feedback brain features in a geminoid augmented architecture
Rosario SorbelloSalvatore TramonteCarmelo CalíMarcello GiardinaShuichi NishioHiroshi IshiguroHiroshi IshiguroAntonio ChellaAntonio Chellasubject
InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.HCI)Cognitive Neurosciencemedia_common.quotation_subjectEmotionsExperimental and Cognitive PsychologyContext (language use)Geminoid050105 experimental psychology03 medical and health sciences0302 clinical medicineArtificial IntelligencePerception0501 psychology and cognitive sciencesAndroid robotmedia_commonCognitive scienceHuman Humanoid Interaction (HHI) Brain Computer Interface (BCI) Geminoid; Android robot Social robot; Cognitive architecture EmotionsCognitive architecture EmotionsMusic psychology05 social sciencesCognitionAndroid robot Social robotHuman Humanoid Interaction (HHI) Brain Computer Interface (BCI) GeminoidCognitive architectureEmbodied cognitionHuman Humanoid Interaction (HHI)Social robotPsychologyBrain Computer Interface (BCI)030217 neurology & neurosurgeryCognitive loadGestureMeaning (linguistics)description
Abstract This paper presents the conceptual framework for a study of musical experience and the associated architecture centred on Human-Humanoid Interaction (HHI). On the grounds of the theoretical and experimental literature on the biological foundation of music, the grammar of music perception and the perception and feeling of emotions in music hearing, we argue that music cognition is specific and that it is realized by a cognitive capacity for music that consists of conceptual and affective constituents. We discuss the relationship between such constituents that enables understanding, that is extracting meaning from music at the different levels of the organization of sounds that are felt as bearers of affects and emotions. To account for the way such cognitive mechanisms are realized in music hearing and extended to movements and gestures we bring in the construct of tensions and of music experience as a cognitive frame. Finally, we describe the principled approach to the design and the architecture of a BCI-controlled robotic system that can be employed to map and specify the constituents of the cognitive capacity for music as well as to simulate their contribution to music meaning understanding in the context of music experience by displaying it through the Geminoid robot movements.
| year | journal | country | edition | language |
|---|---|---|---|---|
| 2018-02-01 |