Search results for "Modality"
showing 10 items of 651 documents
Scheduling Multimodal Transportation Systems
2004
Abstract In this paper a Lagrangian based heuristic procedure for scheduling transportation networks is presented. The solution procedure schedules a single line at a time, possibly correcting the previous decisions at each step.
Early root surface colonization by human periodontal ligament fibroblasts following treatment with different biomaterials
2013
The present in-vitro study examined the effects of different biomaterials on early root surface colonization by human periodontal ligament (PDL) fibroblasts using confocal-laser-scanning-microscopy (CLSM).Fifteen periodontally-diseased teeth were extracted, treated with scaling/root planing and longitudinally cut to obtain 30 root fragments. Fragments were treated either with 24% EDTA following application of enamel matrix derivative (EMD), 24% EDTA or EMD only, nanocrystalline hydroxyapatite (NHA) paste or oily calcium hydroxide suspension (OCHS) for 1 h each. The analogue untreated root specimens served as controls. Root fragments were incubated with human PDL fibroblasts and cellular pro…
Matt Kish’s “Every Page of Moby-Dick, Illustrated”: A Multimodal Approach
2016
Abstract The purpose of this essay is to address the multimodal nature of Matt Kish’s project Every Page of Moby-Dick, Illustrated, where Herman Melville’s 1851 masterpiece is set as paratext. Particular focus is set on the portrayals of Captain Achab, specifically “Page 153”, “Page 465” and “Page 469”. The basic theoretical framework has been offered by Alice Gibbons’ theorization of multimodal cognitive poetics and Sigrid Norris’ systematization of multimodal (inter)action. Useful insight has been lent by Sharon Cameron’s work on allegories of the body in Melville’s writing. The given analysis aims to pinpoint the elements of innovation in Kish’s work with respect to the canonical formal …
Aging effects and feasibility of statistical learning tasks across modalities
2021
Knowledge on statistical learning (SL) in healthy elderly is scarce. Theoretically, it is not clear whether aging affects modality-specific and/or domain-general learning mechanisms. Practically, there is a lack of research on simplified SL tasks, which would ease the burden of testing in clinical populations. Against this background, we conducted two experiments across three modalities (auditory, visual and visuomotor) in a total of 93 younger and older adults. In Experiment 1, SL was induced in all modalities. Aging effects appeared in the tasks relying on an explicit posttest to assess SL. We hypothesize that declines in domain-general processes that predominantly modulate explicit learn…
Single-channel EEG-based subject identification using visual stimuli
2021
Electroencephalography (EEG) signals have been recently proposed as a biometrics modality due to some inherent advantages over traditional biometric approaches. In this work, we studied the performance of individual EEG channels for the task of subject identification in the context of EEG-based biometrics using a recently proposed benchmark dataset that contains EEG recordings acquired under various visual and non-visual stimuli using a low-cost consumer-grade EEG device. Results showed that specific EEG electrodes provide consistently higher identification accuracy regardless of the feature and stimuli types used, while features based on the Mel Frequency Cepstral Coefficients (MFCC) provi…
Neural Multimodal Belief Tracker with Adaptive Attention for Dialogue Systems
2019
Multimodal dialogue systems are attracting increasing attention with a more natural and informative way for human-computer interaction. As one of its core components, the belief tracker estimates the user's goal at each step of the dialogue and provides a direct way to validate the ability of dialogue understanding. However, existing studies on belief trackers are largely limited to textual modality, which cannot be easily extended to capture the rich semantics in multimodal systems such as those with product images. For example, in fashion domain, the visual appearance of clothes play a crucial role in understanding the user's intention. In this case, the existing belief trackers may fail …
Using Internet videos to learn about controversies: Evaluation and integration of multiple and multimodal documents by primary school students
2020
Abstract In many Internet videos authors appear in front of the camera to present their particular view on a topic. Given the high consumption rate of Internet videos by teenagers, we explored the pros and cons of using these videos to learn about complex topics, compared to learning from textual web pages. Specifically, we studied how 207 primary school students (grades 4–6) evaluated and integrated multiple and multimodal web pages (text or video) while learning about the pros and cons of bottled water. Results showed no major role of modality in students' source memory, as measured by citations in their responses to an integration question and their memory for sources. Nevertheless, moda…
MFCC-based Recurrent Neural Network for automatic clinical depression recognition and assessment from speech
2022
Abstract Clinical depression or Major Depressive Disorder (MDD) is a common and serious medical illness. In this paper, a deep Recurrent Neural Network-based framework is presented to detect depression and to predict its severity level from speech. Low-level and high-level audio features are extracted from audio recordings to predict the 24 scores of the Patient Health Questionnaire and the binary class of depression diagnosis. To overcome the problem of the small size of Speech Depression Recognition (SDR) datasets, expanding training labels and transferred features are considered. The proposed approach outperforms the state-of-art approaches on the DAIC-WOZ database with an overall accura…
Gestures in Human-Computer Interaction – Just Another Modality?
2010
The traditional framework in human-computer studies is based on a simple input-output model of interaction. In many cases, however, splitting interaction into input and output is not necessarily appropriate. Gestures work as a good example of a modality which is difficult or inappropriate to be conceptualised within the traditional input-output paradigm. In the search for a more appropriate interaction paradigm, gestures, as modality, have potential in working as a meta-modality, in terms of which all other modalities could be analysed. This paper proposes the use of gestures and gestural metaphors in a central role in interaction design, and presents a case study as an illustration of the …
Benchmarking Saliency Detection Methods on Multimodal Image Data
2018
Saliency detecmage processing. Most of the work is adapted to the specific application and available dataset. The present work is about a comparative analysis of saliency detection for multimodal images dataset. There were many researches on the detection of saliency on several types of images, such as multispectral, natural, 3D and so on. This work presents a first focused study on saliency detection on multimodal images. Our database was extracted from acquisitions on cultural heritage wall paintings that contain four modalities UV, IR, Visible and fluorescence. In this paper, the analysis has been performed for many methods on saliency detection. We evaluate the performance of each metho…