Search results for "modality"
showing 10 items of 651 documents
The soundslide report : innovative journalism or misplaced works of art?
2014
Published version of an article in the journal: Nordicom Review. Also available from the publisher at: http://dx.doi.org/10.2478/nor-2014-0007 Open Access The audio slideshow-or soundslide report-represents a new format for journalistic reporting on online news sites. It is not very widely used, but it has certain discursive and aesthetic potentials indicating that it could contribute substantially to the ecology of journalistic genres. The article offers an illustration and discussion of these potentials, asking how the format communicates and how it affects journalism in general. Starting out with a close reading of a sample text and a discussion of the format's position in a network of g…
Signalling and Reception
2002
Communication, a widespread natural phenomenon, occurs in both animals and plants. Signals are evolved traits that transfer information from one individual (the signaller) to another (the receiver); they can occur in any sensory modality. Keywords: cost and benefits; honesty; mimicry; predation; sexual selection
As We Think We May Teach: Ideologies on IT in the Classroom
2015
The extended use of IT devices has raised scholars’ awareness to its impact on the organization of classroom interactions. Studies claim that the intensive use of IT in the classroom has the potential of revolutionizing education in a way that it increases students’ ownership and control over their learning processes (Ryberg 2013). Others claim that devices such as interactive whiteboards contribute to the emergence of an “effective style” of teaching (Gillen et al. 2007: 254). Further, Lotherington & Ronda (2014) emphasize the role of IT, multimedia, multimodality, collaborative communication, agentive participation and multitasking for a contemporary understanding of what they call “commu…
Health on the net: the doctor answers
2011
This study is intended to provide new insights into web-based discourse on medical exchanges in doctor-patient communication. The global net system have certainly played an important role in the increase and the following modification of communication dynamics. However, in particular situation such as doctor-patient interviews, computer mediated communication is still a limit. This paper is based on two lines of research in language studies, namely the studies of language corpus and studies of communication in health encounters. The corpus is formed by the medical entries that appeared in biomedical/health service sites. The samples collected were analysed in order to find discourse pattern…
Multi-modality of polysomnography signals’ fusion for automatic sleep scoring
2019
Abstract Objective The study aims to develop an automatic sleep scoring method by fusing different polysomnography (PSG) signals and further to investigate PSG signals’ contribution to the scoring result. Methods Eight combinations of four modalities of PSG signals, namely electroencephalogram (EEG), electrooculogram (EOG), electromyogram (EMG), and electrocardiogram (ECG) were considered to find the optimal fusion of PSG signals. A total of 232 features, covering statistical characters, frequency characters, time-frequency characters, fractal characters, entropy characters and nonlinear characters, were derived from these PSG signals. To select the optimal features for each signal fusion, …
Touch or touchless?:Evaluating usability of interactive displays for persons with autistic spectrum disorders
2019
Interactive public displays have been exploited and studied for engaging interaction in several previous studies. In this context, applications have been focused on supporting learning or entertainment activities, specifically designed for people with special needs. This includes, for example, those with Autism Spectrum Disorders (ASD). In this paper, we present a comparison study aimed at understanding the difference in terms of usability, effectiveness, and enjoyment perceived by users with ASD between two interaction modalities usually supported by interactive displays: touch-based and touchless gestural interaction. We present the outcomes of a within-subject setup involving 8 ASD users…
Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text
2016
International audience; Depression is a major cause of disability world-wide. The present paper reports on the results of our participation to the depression sub-challenge of the sixth Audio/Visual Emotion Challenge (AVEC 2016), which was designed to compare feature modalities ( audio, visual, interview transcript-based) in gender-based and gender-independent modes using a variety of classification algorithms. In our approach, both high and low level features were assessed in each modality. Audio features were extracted from the low-level descriptors provided by the challenge organizers. Several visual features were extracted and assessed including dynamic characteristics of facial elements…
Mediated learning materials: visibility checks in telepresence robot mediated classroom interaction
2021
Videoconferencing is increasingly used in education as a way to support distance learning. This article contributes to the emerging interactional literature on video-mediated educational interaction by exploring how a telepresence robot is used to facilitate remote participation in university-level foreign language teaching. A telepresence robot differs from commonly used videoconferencing set-ups in that it allows mobility and remote camera control. A remote student can thus move a classroom-based robot from a distance in order to shift attention between people, objects and environmental structures during classroom activities. Using multimodal conversation analysis, we focus on how partici…
Non-speech voice for sonic interaction: a catalogue
2016
This paper surveys the uses of non-speech voice as an interaction modality within sonic applications. Three main contexts of use have been identified: sound retrieval, sound synthesis and control, and sound design. An overview of different choices and techniques regarding the style of interaction, the selection of vocal features and their mapping to sound features or controls is here displayed. A comprehensive collection of examples instantiates the use of non-speech voice in actual tools for sonic interaction. It is pointed out that while voice-based techniques are already being used proficiently in sound retrieval and sound synthesis, their use in sound design is still at an exploratory p…
A Low-Cost Multi-Modal Auditory-Visual-Tactile Framework for Remote Touch
2020
International audience; Haptic technology for human augmentation provides gains in ability for different applications, whether the aim is to enhance "disabilities" to "abilities", or "abilities" to "super-abilities". Commercially-available devices are generally expensive and tailored to specific applications and hardware. To give researchers a haptic feedback system that is economical, customisable, and fast to fabricate, our group developed a low-cost immersive haptic, audio, and visual experience built by using off-the-shelf (COTS) components. It is composed of a vibrotactile glove, a Leap Motion sensor, and an head-mounted display, integrated together to provide compelling immersive sens…