Search results for "multisensory"
showing 10 items of 51 documents
How Many Clocks, How Many Times? On the Sensory Basis and Computational Challenges of Circadian Systems
2018
A vital task for every organism is not only to decide what to do but also when to do it. For this reason, “circadian clocks” have evolved in virtually all forms of life. Conceptually, circadian clocks can be divided into two functional domains; an autonomous oscillator creates a ~24 h self-sustained rhythm and sensory machinery interprets external information to alter the phase of the autonomous oscillation. It is through this simple design that variations in external stimuli (for example, daylight) can alter our sense of time. However, the clock’s simplicity ends with its basic concept. In metazoan animals, multiple external and internal stimuli, from light to temperature and even metaboli…
Beyond MAYA for game-changing multisensory design
2017
With information technology becoming ever more embedded in our surrounding everyday things, the nature of interactions and the way we experience digitalization is becoming increasingly embodied. Thus, growing effort is placed on examining the multisensory nature of interaction experience. From a design perspective, increased knowledge of how people experience materials and how to design to encourage varying material experiences opens new opportunities for the generation of rich multisensory user experience, and accomplishing game-changing results. In particular, the innovation space opened up by understanding people's material expectations of designs is significant. An experiment (N = 78) w…
Proprioception but not cardiac interoception is related to the rubber hand illusion
2020
The rubber hand illusion (RHI) is a widely used tool in the study of multisensory integration. It develops as the interaction of temporally consistent visual and tactile input, which can overwrite proprioceptive information. Theoretically, the accuracy of proprioception may influence the proneness to the RHI but this has received little research attention to date. Concerning the role of cardioceptive information, the available empirical evidence is equivocal. The current study aimed to test the impact of proprioceptive and cardioceptive input on the RHI. 60 undergraduate students (32 females) completed sensory tasks assessing proprioceptive accuracy with respect to the angle of the elbow jo…
Importance of force feedback for following uneven virtual paths with a stylus
2021
It is commonly known that a physical textured path can be followed by indirect touch through a probe also in absence of vision if sufficiently informative cues are delivered by the other sensory channels, but prior research indicates that the level of performance while following a virtual path on a touchscreen depends on the type and channel such cues belong to. The re-enactment of oriented forces, as they are induced by localized obstacles in probe-based exploration, may be important to equalize the performance between physical and virtual path following. Using a stylus attached to a force-feedback arm, an uneven path marked by virtual bars was traversed while time and positions were measu…
The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech
2018
Metaphoric (MP) co-speech gestures are commonly used during daily communication. They communicate about abstract information by referring to gestures that are clearly concrete (e.g., raising a hand for "the level of the football game is high"). To understand MP co-speech gestures, a multisensory integration at semantic level is necessary between abstract speech and concrete gestures. While semantic gesture-speech integration has been extensively investigated using functional magnetic resonance imaging, evidence from electroencephalography (EEG) is rare. In the current study, we set out an EEG experiment, investigating the processing of MP vs. iconic (IC) co-speech gestures in different cont…
Multisensory integration in hemianopia and unilateral spatial neglect: Evidence from the sound induced flash illusion.
2016
Recent neuropsychological evidence suggests that acquired brain lesions can, in some instances, abolish the ability to integrate inputs from different sensory modalities, disrupting multisensory perception. We explored the ability to perceive multisensory events, in particular the integrity of audio-visual processing in the temporal domain, in brain-damaged patients with visual field defects (VFD), or with unilateral spatial neglect (USN), by assessing their sensitivity to the 'Sound-Induced Flash Illusion' (SIFI). The study yielded two key findings. Firstly, the 'fission' illusion (namely, seeing multiple flashes when a single flash is paired with multiple sounds) is reduced in both left- …
Unconscious integration of multisensory bodily inputs in the peripersonal space shapes bodily self-consciousness
2017
International audience; Recent studies have highlighted the role of multisensory integration as a key mechanism of self-consciousness. In particular, integration of bodily signals within the peripersonal space (PPS) underlies the experience of the self in a body we own (self-identification) and that is experienced as occupying a specific location in space (self-location), two main components of bodily self-consciousness (BSC). Experiments investigating the effects of multisensory integration on BSC have typically employed supra-threshold sensory stimuli, neglecting the role of unconscious sensory signals in BSC, as tested in other consciousness research. Here, we used psychophysical techniq…
Initial information prior to movement onset influences kinematics of upward arm pointing movements
2016
International audience; To elaborate a motor plan and perform online control in the gravity field, the brain relies on priors and multisensory integration of information. In particular, afferent and efferent inputs related to the initial state are thought to convey sensorimotor information to plan the upcoming action. Yet it is still unclear to what extent these cues impact motor planning. Here we examined the role of initial information on the planning and execution of arm movements. Participants performed upward arm movements around the shoulder at three speeds and in two arm conditions. In the first condition, the arm was outstretched horizontally and required a significant muscular comm…
Audiovisual Integration of Time-to-Contact Information for Approaching Objects.
2018
Previous studies of time-to-collision (TTC) judgments of approaching objects focused on effectiveness of visual TTC information in the optical expansion pattern (e.g., visual tau, disparity). Fewer studies examined effectiveness of auditory TTC information in the pattern of increasing intensity (auditory tau), or measured integration of auditory and visual TTC information. Here, participants judged TTC of an approaching object presented in the visual or auditory modality, or both concurrently. TTC information provided by the modalities was jittered slightly against each other, so that auditory and visual TTC were not perfectly correlated. A psychophysical reverse correlation approach was us…
Multisensory integration of drumming actions: musical expertise affects perceived audiovisual asynchrony
2009
We investigated the effect of musical expertise on sensitivity to asynchrony for drumming point-light displays, which varied in their physical characteristics (Experiment 1) or in their degree of audiovisual congruency (Experiment 2). In Experiment 1, 21 repetitions of three tempos x three accents x nine audiovisual delays were presented to four jazz drummers and four novices. In Experiment 2, ten repetitions of two audiovisual incongruency conditions x nine audiovisual delays were presented to 13 drummers and 13 novices. Participants gave forced-choice judgments of audiovisual synchrony. The results of Experiment 1 show an enhancement in experts' ability to detect asynchrony, especially fo…