Search results for "multisensory"

Brain circuit-gene expression relationships and neuroplasticity of multisensory cortices in blind children.

2017

Sensory deprivation reorganizes neurocircuits in the human brain. The biological basis of such neuroplastic adaptations remains elusive. In this study, we applied two complementary graph theory-based functional connectivity analyses, one to evaluate whole-brain functional connectivity relationships and the second to specifically delineate distributed network connectivity profiles downstream of primary sensory cortices, to investigate neural reorganization in blind children compared with sighted controls. We also examined the relationship between connectivity changes and neuroplasticity-related gene expression profiles in the cerebral cortex. We observed that multisensory integration areas e…

Multisensory texture exploration at the tip of the pen

2016

A tool for the multisensory stylus-based exploration of virtual textures was used to investigate how different feedback modalities (static or dynamically deformed images, vibration, sound) affect exploratory gestures. To this end, we ran an experiment where participants had to steer a path with the stylus through a curved corridor on the surface of a graphic tablet/display, and we measured steering time, dispersion of trajectories, and applied force. Despite the variety of subjective impressions elicited by the different feedback conditions, we found that only nonvisual feedback induced significant variations in trajectories and an increase in movement time. In a post-experiment, using a pa…

Seeing odors in color: Cross-modal associations in children and adults from two cultural environments

2018

International audience; We investigated the occurrence and underlying processes of odor–color associations in French and American 6- to 10-year-old children (n = 386) and adults (n = 137). Nine odorants were chosen according to their familiarity to either cultural group. Participants matched each odor with a color, gave hedonic and familiarity judgments, and identified each odor. By 6 years of age, children displayed culture-specific odor–color associations, but age differences were noted in the type of associations. Children and adults in both cultural groups shared common associations and formed associations that were unique to their environment, underscoring the importance of exposure le…

Ability for Voice Recognition Is a Marker for Dyslexia in Children

2014

A recent voice recognition experiment conducted by Perrachione, Del Tufo, and Gabrieli (2011) revealed that, in normal adult readers, the accuracy at identifying human voices was better in the participants’ mother tongue than in an unfamiliar language, while this difference was absent in a group of adults with dyslexia. This pattern favored a view of dyslexia as due to “fundamentally impoverished native-language phonological representations.” To further examine this issue, we conducted two voice recognition experiments, one with children with/without dyslexia, and the other with adults with/without dyslexia. Results revealed that children/adults with dyslexia were less accurate at identify…

The EEG and fMRI signatures of neural integration: An investigation of meaningful gestures and corresponding speech

2015

Abstract One of the key features of human interpersonal communication is our ability to integrate information communicated by speech and accompanying gestures. However, it is still not fully understood how this essential combinatory process is represented in the human brain. Functional magnetic resonance imaging (fMRI) studies have unanimously attested the relevance of activation in the posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG), while electroencephalography (EEG) studies have shown oscillatory activity in specific frequency bands to be associated with multisensory integration. In the current study, we used fMRI and EEG to separately investigate the anatomical and o…

The Auditory Kuleshov Effect: Multisensory Integration in Movie Editing

2016

Almost a hundred years ago, the Russian filmmaker Lev Kuleshov conducted his now famous editing experiment in which different objects were added to a given film scene featuring a neutral face. It is said that the audience interpreted the unchanged facial expression as a function of the added object (e.g., an added soup made the face express hunger). This interaction effect has been dubbed “Kuleshov effect.” In the current study, we explored the role of sound in the evaluation of facial expressions in films. Thirty participants watched different clips of faces that were intercut with neutral scenes, featuring either happy music, sad music, or no music at all. This was crossed with the facia…

Subjective, behavioral, and physiological responses to the rubber hand illusion do not vary with age in the adult phase.

2018

[EN] The Rubber Hand Illusion (RHI) is a perceptual illusion that enables integration of artificial limbs into the body representation through combined multisensory integration. Most previous studies investigating the RHI have involved young healthy adults within a very narrow age range (typically 20-30 years old). The purpose of this paper was to determine the influence of age on the RHI. The RHI was performed on 93 healthy adults classified into three groups of age (20-35 years old, N = 41; 36-60 years old, N = 28; and 61-80 years old, N = 24), and its effects were measured with subjective (Embodiment of Rubber Hand Questionnaire), behavioral (proprioceptive drift), and physiological (cha…

Editorial: Timing the Brain: From Basic Sciences to Clinical Implications

2022

Temporal Binding in Multisensory and Motor-Sensory Contexts: Toward a Unified Model

2021

Our senses receive a manifold of sensory signals at any given moment in our daily lives. For a coherent and unified representation of information and precise motor control, our brain needs to temporally bind the signals emanating from a common causal event and segregate others. Traditionally, different mechanisms were proposed for the temporal binding phenomenon in multisensory and motor-sensory contexts. This paper reviews the literature on the temporal binding phenomenon in both multisensory and motor-sensory contexts and suggests future research directions for advancing the field. Moreover, by critically evaluating the recent literature, this paper suggests that common computational prin…

Multisensory discourse resources : decolonizing ethnographic research practices

2020

Researchers have attempted to address the intersection of multisensory and multimodal discourse practices from an interactional perspective. This study argues for the value of experiential, non-interactional multisensory discourse resources and proposes a conceptual framework of multisensory discourse resources to bridge visual and family language ideology ethnography. A year-long ethnographic case study of three Nepalese families (immigrant and transmigrant), consisting of 150 h of observational data triangulated with qualitative interviews, posed two questions: (1) How do transnational families, in the homescape, use multisensory discourse resources to provide cultural, national, religiou…