6533b86dfe1ef96bd12ca15c

RESEARCH PRODUCT

Sketching Sound with Voice and Gesture

Patrick SusiniDavide RocchessoPatrick BoussardSten TernströmGuillaume Lemaitre

subject

geographygeography.geographical_feature_categorySettore INF/01 - InformaticaInformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.HCI)Computer scienceSpeech recognitionSound designInteraction designSound designsonic interaction design[PHYS.MECA.ACOU]Physics [physics]/Mechanics [physics]/Acoustics [physics.class-ph]Human-Computer InteractionimitationsProduct (mathematics)[SCCO.PSYC]Cognitive science/PsychologyNatural (music)Sound (geography)ComputingMilieux_MISCELLANEOUSGesture

description

Voice and gestures are natural sketching tools that can be exploited to communicate sonic interactions. In product and interaction design, sounds should be included in the early stages of the design process. Scientists of human motion have shown that auditory stimuli are important in the performance of difficult tasks and can elicit anticipatory postural adjustments in athletes. These findings justify the attention given to sound in interaction design for gaming, especially in action and sports games that afford the development of levels of virtuosity. The sonic manifestations of objects can be designed by acting on their mechanical qualities and by augmenting the objects with synthetic and responsive sounds

10.1145/2685501https://hal.archives-ouvertes.fr/hal-01260448