Search results for "Sonification"

Musical Sonification of Arm Movements in Stroke Rehabilitation Yields Limited Benefits.

2019

Neurologic music therapy in rehabilitation of stroke patients has been shown to be a promising supplement to the often strenuous conventional rehabilitation strategies. The aim of this study was threefold: (i) replicate results from a previous study with a sample from one clinic (henceforth called Site 1; N = 12) using an already established recording system, and (ii) conceptually replicate previous findings with a less costly hand-tracking system in Site 2 (N = 30), and (iii) compare both sub-studies' outcomes to estimate the efficiency of neurologic music therapy. Stroke patients in both sites were randomly assigned to treatment or control groups and received daily training of guided sequ…

2015

Visuo-auditory sensory substitution systems are augmented reality devices that translate a video stream into an audio stream in order to help the blind in daily tasks requiring visuo-spatial information. In this work, we present both a new mobile device and a transcoding method specifically designed to sonify moving objects. Frame differencing is used to extract spatial features from the video stream and two-dimensional spatial information is converted into audio cues using pitch, interaural time difference and interaural level difference. Using numerical methods, we attempt to reconstruct visuo-spatial information based on audio signals generated from various video stimuli. We show that de…

Quantum GestART: Identifying and Applying Correlations between Mathematics, Art, and Perceptual Organization

2020

Mathematics can help analyze the arts and inspire new artwork. Mathematics can also help make transformations from one artistic medium to another, considering exceptions and choices, as well as artists' individual and unique contributions. We propose a method based on diagrammatic thinking and quantum formalism. We exploit decompositions of complex forms into a set of simple shapes, discretization of complex images, and Dirac notation, imagining a world of "prototypes" that can be connected to obtain a fine or coarse-graining approximation of a given visual image. Visual prototypes are exchanged with auditory ones, and the information (position, size) characterizing visual prototypes is con…

Sonification of Emotion : Strategies for Continuous Display of Arousal and Valence

2013

Sonification is an interdisciplinary field of research broadly interested in the use of sound to convey information. A fundamental attribute of sound is its ability to evoke emotion, but the display of emotion as a continuous data type has not yet received adequate attention. This paper motivates the use of sonification for display of emotion in affective computing, and as a means of targeting mechanisms of emotion elicitation in music. Environmental sound and music are presented as two possible sources for non-verbal auditory emotion elicitation, each with specific determinants and available features. The review concludes that the auditory-cognitive mechanisms of brain-stem reflex and emot…

Acoustic rendering of particle-based simulation of liquids in motion

2009

In interaction and interface design, the representation of continuous processes often uses liquid metaphors, such as dripping or streaming. When an auditory display of such processes is required, an approach to sound-synthesis based on the physics of liquids in motion would be the most convincing, especially when real-time interaction is into play. In order to bridge the complexity of fluid-dynamic simulations with the needs of interactive sonification, we propose a multi-rate sound synthesis of liquid phenomena. Low-rate smoothed-particle hydrodynamics is used to model liquids in motion and to trigger sound-emitting events. Such events, such as solid-liquid collision, or bubble formation, …

The use of sonification for physiotherapy in human movement tasks: A scoping review

2020

Objectives: This review aims to: (1) map the use of sonification in human movement tasks for physical therapy; (2) identify methods of data capture, tasks and its effects on human subjects; (3) suggest future research directions. News: Sonification can be described as a technique to translate data into sound. It has been used for human motion analysis tasks even if it is not part of most physical therapist's lexicon. Prospects and projects: Identify and analyze publications where sonification was used as an audio-feedback technique for physical therapy. Thirty-five papers were included, 13 randomized-control-trials. Thirteen papers reported an investigation on a specific dysfunction, while …

Interaction by ear

2019

Abstract Speech-based interaction is now part of our everyday experiences, in the home and on the move. More subtle is the presence of designed non-speech sounds in human-machine interactions, and far less evident is their importance to create aural affordances and to support human actions. However, new application areas for interactive sound, beyond the domains of speech and music, have been emerging. These range from tele-operation and way-finding, to peripheral process monitoring and augmented environments. Beyond signalling location, presence, and states, future sounding artifacts are expected to be plastic and reconfigurable, and take into account the inherently egocentric nature of so…

Quantum RoboSound: Auditory Feedback of a Quantum-Driven Robotic Swarm

2022

Data sonification enhance and enrich information understanding with an additional sensory dimension. Sonification also opens the way to more creative applications, joining arts and sciences. In this study, we present sequences of chords obtained as auditory feedback from the trajectories of a robotic swarm. The swarm behavior is an emerging effect from simple local interactions and autonomous decisions of each robot. The swarm effect can be identified through sonification outcomes in terms of voice leading patterns. Thus, chord patterns represent behavior patterns. The convergence to the target is represented by the convergence to a specific pitch. The swarm decision process is based upon q…

A perceptual sound space for auditory displays based on sung-vowel synthesis.

2022

AbstractWhen designing displays for the human senses, perceptual spaces are of great importance to give intuitive access to physical attributes. Similar to how perceptual spaces based on hue, saturation, and lightness were constructed for visual color, research has explored perceptual spaces for sounds of a given timbral family based on timbre, brightness, and pitch. To promote an embodied approach to the design of auditory displays, we introduce the Vowel–Type–Pitch (VTP) space, a cylindrical sound space based on human sung vowels, whose timbres can be synthesized by the composition of acoustic formants and can be categorically labeled. Vowels are arranged along the circular dimension, whi…

Trajectory-based and Sound-based Medical Data Clustering

2022

Challenges in medicine are often faced as interdisciplinary endeav- ors. In such an interdisciplinary view, sonification of medical data provides an additional sensory dimension to highlight often hard- to-find information and details. Some examples of sonification of medical data include Covid genome mapping [5], auditory repre- sentations of tridimensional objects as the brain [4], enhancement of medical imagery through the use of sound [1]. Here, we focus on kidney filtering-efficiency time-evolution data. We consider the estimated glomerular filtration rate (eGFR), the main indicator of kidney efficiency in diabetic kidney disease patients.1 We propose a technique to sonify the eGFR tra…