Search results for "Gestures"
showing 10 items of 43 documents
The EEG and fMRI signatures of neural integration: An investigation of meaningful gestures and corresponding speech
2015
Abstract One of the key features of human interpersonal communication is our ability to integrate information communicated by speech and accompanying gestures. However, it is still not fully understood how this essential combinatory process is represented in the human brain. Functional magnetic resonance imaging (fMRI) studies have unanimously attested the relevance of activation in the posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG), while electroencephalography (EEG) studies have shown oscillatory activity in specific frequency bands to be associated with multisensory integration. In the current study, we used fMRI and EEG to separately investigate the anatomical and o…
The facilitative effect of gestures on the neural processing of semantic complexity in a continuous narrative
2019
© 2019 Elsevier Inc. Gestures are elemental components of social communication and aid comprehension of verbal messages; however, little is known about the potential role of gestures in facilitating processing of semantic complexity in an ecologically valid setting. The goal of this study was to investigate whether cognitive load, as indexed by semantic complexity, is modulated by the presentation of gestures accompanying speech. Twenty healthy participants watched 16 video clips of a short narrative while instructed to carefully listen to and watch the narrator while functional magnetic resonance imaging (fMRI) data were acquired. The videos contained passages with and without various co-s…
Neural dynamics of learning sound-action associations.
2008
A motor component is pre-requisite to any communicative act as one must inherently move to communicate. To learn to make a communicative act, the brain must be able to dynamically associate arbitrary percepts to the neural substrate underlying the pre-requisite motor activity. We aimed to investigate whether brain regions involved in complex gestures (ventral pre-motor cortex, Brodmann Area 44) were involved in mediating association between novel abstract auditory stimuli and novel gestural movements. In a functional resonance imaging (fMRI) study we asked participants to learn associations between previously unrelated novel sounds and meaningless gestures inside the scanner. We use functio…
Evidence for gesture-speech mismatch detection impairments in schizophrenia.
2019
Patients with schizophrenia suffer from impairments in the perception and production of gestures. The extent to which patients can access the semantic association between speech and co-verbal gestures in concrete or abstract/metaphorical meaning contexts is unknown. We investigated 1) how patients differ from controls in gesture matching performance, 2) how performance differs in the context of abstract versus concrete meaning, and 3) whether formal thought disorder (FTD) symptom severity predicts task impairment. Forty-five patients with schizophrenia spectrum disorders (two subgroups, mild and severe) took part in this study. Participants were presented with video clips, each showing an a…
Implicit visual analysis in handedness recognition.
1998
In the present study, we addressed the problem of whether hand representations, derived from the control of hand gesture, are used in handedness recognition. Pictures of hands and fingers, assuming either common or uncommon postures, were presented to right-handed subjects, who were required to judge their handedness. In agreement with previous results (Parsons, 1987, 1994; Gentilucci, Daprati, & Gangitano, 1998), subjects recognized handedness through mental movement of their own hand in order to match the posture of the presented hand. This was proved by a control experiment of physical matching. The new finding was that presentation of common finger postures affected responses differ…
Gesture's body orientation modulates the N400 for visual sentences primed by gestures
2020
Abstract Body orientation of gesture entails social‐communicative intention, and may thus influence how gestures are perceived and comprehended together with auditory speech during face‐to‐face communication. To date, despite the emergence of neuroscientific literature on the role of body orientation on hand action perception, limited studies have directly investigated the role of body orientation in the interaction between gesture and language. To address this research question, we carried out an electroencephalography (EEG) experiment presenting to participants (n = 21) videos of frontal and lateral communicative hand gestures of 5 s (e.g., raising a hand), followed by visually presented …
Neural Basis of Speech-Gesture Mismatch Detection in Schizophrenia Spectrum Disorders
2021
AbstractPatients with schizophrenia spectrum disorders (SSD) exhibit an aberrant perception and comprehension of abstract speech-gesture combinations associated with dysfunctional activation of the left inferior frontal gyrus (IFG). Recently, a significant deficit of speech-gesture mismatch detection was identified in SSD, but the underlying neural mechanisms have not yet been examined. A novel mismatch-detection fMRI paradigm was implemented manipulating speech-gesture abstractness (abstract/concrete) and relatedness (related/unrelated). During fMRI data acquisition, 42 SSD patients (schizophrenia, schizoaffective disorder, or other non-organic psychotic disorder [ICD-10: F20, F25, F28; DS…
Kindergarten children's argumentation in reflection symmetry: The role of semiotic means
2017
International audience; In this paper I investigate the characteristics of children's argumentation when they work with reflection symmetry. Using Toulmin's (2003) model for substantial argumentation, I illuminate structural aspects of the ongoing argumentation. In addition, I analyse the children's argumentation with respect to their use of semiotic means. Results show that children are able to argue for a claim in a quite complex manner. The study also illustrates the extensive use of semiotic means in children's argumentation. In every element in the argumentative structure, children use gestures and other semiotic means to mediate their ideas. It is actually impossible to make sense of …
Utenfor og innenfor : En kvalitativ studie av skolen som sosial arena – og dens betydning for ungdoms psykiske helse
2017
Masteroppgave psykisk helsearbeid ME504 - Universitetet i Agder 2017 Background Exclusion still have good conditions in school today. In this study, mental health and quality of life are seen in relation to school as a social arena and from the youth's perspective. Aim and research question I want to contribute to creating opportunities for new practices in school, in the way they work with mental health and quality of life. Research question: What importance has school as a social arena, when youth who have sought mental health care and the people in the network describe the difficulties - and change for the better? Method The study has a hermeneutical phenomenological approach. The main m…
Modality-specific dysfunctional neural processing of social-abstract and non-social-concrete information in schizophrenia
2021
Highlights • Social/non-social information processing in three modalities was investigated in SZ. • SZ showed reduced activation for social information only in gesture modality. • Reduced activation in SZ was observed for non-social information only in speech. • Neural Neural processing in bimodal condition is not different between patients and controls.