Search results for "Audio-visual"
showing 6 items of 16 documents
Top-Down Predictions of Familiarity and Congruency in Audio-Visual Speech Perception at Neural Level.
2019
During speech perception, listeners rely on multimodal input and make use of both auditory and visual information. When presented with speech, for example syllables, the differences in brain responses to distinct stimuli are not, however, caused merely by the acoustic or visual features of the stimuli. The congruency of the auditory and visual information and the familiarity of a syllable, that is, whether it appears in the listener’s native language or not, also modulates brain responses. We investigated how the congruency and familiarity of the presented stimuli affect brain responses to audio-visual (AV) speech in 12 adult Finnish native speakers and 12 adult Chinese native speakers. The…
Top-Down Predictions of Familiarity and Congruency in Audio-Visual Speech Perception at Neural Level
2019
During speech perception, listeners rely on multimodal input and make use of both auditory and visual information. When presented with speech, for example syllables, the differences in brain responses to distinct stimuli are not, however, caused merely by the acoustic or visual features of the stimuli. The congruency of the auditory and visual information and the familiarity of a syllable, that is, whether it appears in the listener’s native language or not, also modulates brain responses. We investigated how the congruency and familiarity of the presented stimuli affect brain responses to audio-visual (AV) speech in 12 adult Finnish native speakers and 12 adult Chinese native speakers. The…
Top-Down Predictions of Familiarity and Congruency in Audio-Visual Speech Perception at Neural Level
2019
During speech perception, listeners rely on multimodal input and make use of both auditory and visual information. When presented with speech, for example syllables, the differences in brain responses to distinct stimuli are not, however, caused merely by the acoustic or visual features of the stimuli. The congruency of the auditory and visual information and the familiarity of a syllable, that is, whether it appears in the listener's native language or not, also modulates brain responses. We investigated how the congruency and familiarity of the presented stimuli affect brain responses to audio-visual (AV) speech in 12 adult Finnish native speakers and 12 adult Chinese native speakers. The…
Exploring Music Video Experiences and Their Influence on Music Perception
2022
Streaming music videos on the internet is an increasingly popular music listening activity that has remained virtually unexplored within music psychology. Studies of the role of music in film, as well as empirical research investigating the influence of audio-visual media and memory, have shown that visual information can have a profound effect on how music is perceived and remembered. The current study aimed to create a framework for understanding music video (MV) experiences by finding out when and why individuals choose to engage with this form of media, how these experiences contribute to the perception of musical meaning and influence affective outcomes, and whether these effects carr…
All Eyes on Me : Behaving as Soloist in Duo Performances Leads to Increased Body Movements and Attracts Observers’ Visual Attention
2020
Duo musicians exhibit a broad variety of bodily gestures, but it is unclear how soloists’ and accompanists’ movements differ and to what extent they attract observers’ visual attention. In Experiment 1, seven musical duos’ body movements were tracked while they performed two pieces in two different conditions. In a congruent condition, soloist and accompanist behaved according to their expected musical roles; in an incongruent condition, the soloist behaved as accompanist and vice versa. Results revealed that behaving as soloist, regardless of the condition, led to more, smoother, and faster head and shoulder movements over a larger area than behaving as accompanist. Moreover, accompanists …
Communicating through ancillary gestures: Exploring effects on coperformers and audiences
2020
Musicians make elaborate movements while performing, often using gestures that might seem extraneous. To explore these movements, we motion-captured and audio-recorded different pairings of clarinetists and pianists performing Brahms’ Clarinet Sonata No. 1 with two manipulations: (a) allowing the performers full vs. no visual feedback, and (b) allowing the performers full vs. partial auditory feedback (i.e., the clarinetist could not hear the pianist). We found that observer ratings of audio–visual point-light renditions discriminated between manipulations and refined this insight through subsequent audio-alone and visual-alone experiments, providing an understanding of each modality’s cont…