0000000000963593
AUTHOR
Yifei He
showing 8 related works from this author
Gesture's body orientation modulates the N400 for visual sentences primed by gestures
2020
Abstract Body orientation of gesture entails social‐communicative intention, and may thus influence how gestures are perceived and comprehended together with auditory speech during face‐to‐face communication. To date, despite the emergence of neuroscientific literature on the role of body orientation on hand action perception, limited studies have directly investigated the role of body orientation in the interaction between gesture and language. To address this research question, we carried out an electroencephalography (EEG) experiment presenting to participants (n = 21) videos of frontal and lateral communicative hand gestures of 5 s (e.g., raising a hand), followed by visually presented …
The facilitative effect of gestures on the neural processing of semantic complexity in a continuous narrative
2019
© 2019 Elsevier Inc. Gestures are elemental components of social communication and aid comprehension of verbal messages; however, little is known about the potential role of gestures in facilitating processing of semantic complexity in an ecologically valid setting. The goal of this study was to investigate whether cognitive load, as indexed by semantic complexity, is modulated by the presentation of gestures accompanying speech. Twenty healthy participants watched 16 video clips of a short narrative while instructed to carefully listen to and watch the narrator while functional magnetic resonance imaging (fMRI) data were acquired. The videos contained passages with and without various co-s…
Modality-specific dysfunctional neural processing of social-abstract and non-social-concrete information in schizophrenia
2021
Highlights • Social/non-social information processing in three modalities was investigated in SZ. • SZ showed reduced activation for social information only in gesture modality. • Reduced activation in SZ was observed for non-social information only in speech. • Neural Neural processing in bimodal condition is not different between patients and controls.
Gesture’s body orientation modulates the N400 during semantic integration of gesture and visual sentence
2020
AbstractBody orientation of gesture entails social-communicative intention, and may thus influence how gestures are perceived and comprehended together with auditory speech during face-to-face communication. To date, despite the emergence of neuroscientific literature on the role of body orientation on hand action perception, limited studies have directly investigated the role of body orientation in the interaction between gesture and language. To address this research question, we carried out an EEG experiment presenting to participants (n=21) videos of frontal and lateral hand gestures of five-seconds (e.g., raising a hand), followed by visually presented sentences that are either congrue…
The effects of job satisfaction and psychological resilience on job performance among residents of the standardized residency training: a nationwide …
2020
High resident job performance is essential for effective medical professionalism. To date, few studies have investigated the potential predictors of job performance among residents in standardized residency training (SRT) program in China. Therefore, a nationwide survey among Chinese residents in SRT program was conducted to evaluate the impact of job satisfaction and psychological resilience on job performance. A total of 1146 residents from 9 hospitals were recruited in this study. Demographic and work-related information, job satisfaction, psychological resilience and job performance were collected through questionnaires. Hierarchical regression analyses indicated that, "work pressure", …
The EEG and fMRI signatures of neural integration: An investigation of meaningful gestures and corresponding speech
2015
Abstract One of the key features of human interpersonal communication is our ability to integrate information communicated by speech and accompanying gestures. However, it is still not fully understood how this essential combinatory process is represented in the human brain. Functional magnetic resonance imaging (fMRI) studies have unanimously attested the relevance of activation in the posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG), while electroencephalography (EEG) studies have shown oscillatory activity in specific frequency bands to be associated with multisensory integration. In the current study, we used fMRI and EEG to separately investigate the anatomical and o…
The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech
2018
Metaphoric (MP) co-speech gestures are commonly used during daily communication. They communicate about abstract information by referring to gestures that are clearly concrete (e.g., raising a hand for "the level of the football game is high"). To understand MP co-speech gestures, a multisensory integration at semantic level is necessary between abstract speech and concrete gestures. While semantic gesture-speech integration has been extensively investigated using functional magnetic resonance imaging, evidence from electroencephalography (EEG) is rare. In the current study, we set out an EEG experiment, investigating the processing of MP vs. iconic (IC) co-speech gestures in different cont…
Modality-specific dysfunctional neural processing of social and non-social information in schizophrenia
2020
Abstract Background Schizophrenia (SZ) is characterized by marked social dysfunctions encompassing potential deficits in the processing of social and non-social information, especially in everyday settings where multiple modalities are present. To date, the neurobiological basis of these deficits remains elusive. Methods In a functional magnetic resonance imaging (fMRI) study, 17 patients with schizophrenia or schizoaffective disorder, and 18 matched controls watched videos of an actor speaking, gesturing (unimodal), and both speaking and gesturing (bimodal) about social or non-social events in a naturalistic way. Participants had to judge whether each video contains person-related (social)…