Search results for "modality."
showing 10 items of 631 documents
Multi-modality of polysomnography signals’ fusion for automatic sleep scoring
2019
Abstract Objective The study aims to develop an automatic sleep scoring method by fusing different polysomnography (PSG) signals and further to investigate PSG signals’ contribution to the scoring result. Methods Eight combinations of four modalities of PSG signals, namely electroencephalogram (EEG), electrooculogram (EOG), electromyogram (EMG), and electrocardiogram (ECG) were considered to find the optimal fusion of PSG signals. A total of 232 features, covering statistical characters, frequency characters, time-frequency characters, fractal characters, entropy characters and nonlinear characters, were derived from these PSG signals. To select the optimal features for each signal fusion, …
Touch or touchless?:Evaluating usability of interactive displays for persons with autistic spectrum disorders
2019
Interactive public displays have been exploited and studied for engaging interaction in several previous studies. In this context, applications have been focused on supporting learning or entertainment activities, specifically designed for people with special needs. This includes, for example, those with Autism Spectrum Disorders (ASD). In this paper, we present a comparison study aimed at understanding the difference in terms of usability, effectiveness, and enjoyment perceived by users with ASD between two interaction modalities usually supported by interactive displays: touch-based and touchless gestural interaction. We present the outcomes of a within-subject setup involving 8 ASD users…
Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text
2016
International audience; Depression is a major cause of disability world-wide. The present paper reports on the results of our participation to the depression sub-challenge of the sixth Audio/Visual Emotion Challenge (AVEC 2016), which was designed to compare feature modalities ( audio, visual, interview transcript-based) in gender-based and gender-independent modes using a variety of classification algorithms. In our approach, both high and low level features were assessed in each modality. Audio features were extracted from the low-level descriptors provided by the challenge organizers. Several visual features were extracted and assessed including dynamic characteristics of facial elements…
Mediated learning materials: visibility checks in telepresence robot mediated classroom interaction
2021
Videoconferencing is increasingly used in education as a way to support distance learning. This article contributes to the emerging interactional literature on video-mediated educational interaction by exploring how a telepresence robot is used to facilitate remote participation in university-level foreign language teaching. A telepresence robot differs from commonly used videoconferencing set-ups in that it allows mobility and remote camera control. A remote student can thus move a classroom-based robot from a distance in order to shift attention between people, objects and environmental structures during classroom activities. Using multimodal conversation analysis, we focus on how partici…
Non-speech voice for sonic interaction: a catalogue
2016
This paper surveys the uses of non-speech voice as an interaction modality within sonic applications. Three main contexts of use have been identified: sound retrieval, sound synthesis and control, and sound design. An overview of different choices and techniques regarding the style of interaction, the selection of vocal features and their mapping to sound features or controls is here displayed. A comprehensive collection of examples instantiates the use of non-speech voice in actual tools for sonic interaction. It is pointed out that while voice-based techniques are already being used proficiently in sound retrieval and sound synthesis, their use in sound design is still at an exploratory p…
The Multimodality of Digital Longform Journalism
2016
Digital longform journalism has recently attracted increased attention among both academics and professionals. This study contributes to the growing body of research by dissecting the multimodal structure of digital longform journalism, that is, how the emerging genre combines written language, photography, short videos, maps and other graphical elements, and joins them together into a seamless narrative using subtle transitions. The data consist of 12 longform articles published in 2012–2013, which have been annotated for their visual and verbal content, their underlying principle of organization and the transitions that hold between them. The annotation is stored into a digital corpus, wh…
Dental CBCT equipment and performance issues
2012
Dental cone beam computed tomography (CBCT), also known as digital volumetric tomography was developed in the late 1990s and is now increasingly available in clinical practice. It can provide high resolution cross-sectional images of teeth and the maxillofacial region with applications in all branches of dentistry. As a new imaging modality, there were no established suspension levels at a European level. A literature review, encompassing scientific, professional publications and existing national guidelines was performed in an attempt to develop a set of suspension levels for dental CBCT, using additional expert opinion from the members of the European Academy of dento-maxillo-facial radio…
Co-participatory multimodal intergenerational storytelling : preschool children’s relationship with modality creating elder inclusion
2021
The COVID-19 crisis has highlighted elderly people as a vulnerable and excluded community, and connecting to the younger social media generation requires a shift in intergenerational storytelling performance. Recent research on multimodality has emphasized its benefits for the interactional process in storytelling. This study examines three aspects of storytelling – participation, multimodality, and emotional interaction – and uses co-creation and multimodal discourse analysis to investigate two questions: (1) To what extent can intergenerational storytelling benefit older people’s community engagement? (2) In a globalized world, how do children’s relationships with modalities create new l…
Modality and Uncertainty in Data Visualizations: A Corpus Approach to the Use of Connecting Lines
2020
In data visualizations, connecting lines may have various semiotic functions, including the semiotic potential of indicating modality and uncertainty. The goal of this article is to find out how this semiotic potential is realized in current best practices of data visualizations and what conventions exist for the visual manifestations of these functions. This issue is addressed by using a corpus-based approach and a two-level analysis method within a social semiotic framework. First, the article offers a theoretical discussion on how the concepts of modality and uncertainty interrelate. Second, a method for investigating how these concepts are visualized at different levels is presented. Th…
Multicomponent Exercise Training Combined with Nutritional Counselling Improves Physical Function, Biochemical and Anthropometric Profiles in Obese C…
2020
Aerobics or strength exercise plus diet interventions have been shown to counteract childhood obesity. However, little is known with regard to periodized multicomponent exercise interventions combined with nutritional counselling, which might be less demanding but more enjoyable and respectful of children and adolescents&rsquo