Search results for "Multimodal"

Monadic second-order logic over pictures and recognizability by tiling systems

1994

We show that a set of pictures (rectangular arrays of symbols) is recognized by a finite tiling system if and only if it is definable in existential monadic second-order logic. As a consequence, finite tiling systems constitute a notion of recognizability over two-dimensional inputs which at the same time generalizes finite-state recognizability over strings and matches a natural logic. The proof is based on the Ehrenfeucht-FraIsse technique for first-order logic and an implementation of “threshold counting” within tiling systems.

BIG-AFF

2017

Recent research has provided solid evidence that emotions strongly affect motivation and engagement, and hence play an important role in learning. In BIG-AFF project, we build on the hypothesis that ``it is possible to provide learners with a personalised support that enriches their learning process and experience by using low intrusive (and low cost) devices to capture affective multimodal data that include cognitive, behavioural and physiological information''. In order to deal with the affect management complete cycle, thus covering affect detection, modelling and feedback, there is lack of standards and consolidated methodologies. Being our goal to develop realistic affect-aware learnin…

Chirurgie des métastases pulmonaires des cancers colorectaux : facteurs prédictifs de survie

2016

Resume Introduction Le cancer colorectal represente la 3e cause de mortalite par cancer : 5 % des patients vont developper des metastases pulmonaires. Le concept de chirurgie des cancers oligometastatiques est base sur l’objectif d’un controle local optimal de la maladie. Etat des connaissances A ce jour, aucun essai controle randomise ne valide la chirurgie de resection des metastases pulmonaires des patients oligometastatiques porteurs d’un cancer colorectal controle localement. Cependant, de nombreuses series, le plus souvent retrospectives, rapportent des survies prolongees chez des patients tres selectionnes, allant de 45 a 65 % a 5 ans dans les series les plus recentes. Les facteurs c…

Multimodal Image Segmentation for Radiation Treatment Planning

A fully automatic approach for multimodal PET and MR image segmentation in gamma knife treatment planning

2017

The aim of this study is to combine Biological Target Volume (BTV) segmentation and Gross Target Volume (GTV) segmentation in stereotactic neurosurgery.Our goal is to enhance Clinical Target Volume (CTV) definition, including metabolic and morphologic information, for treatment planning and patient follow-up.We propose a fully automatic approach for multimodal PET and MR image segmentation. This method is based on the Random Walker (RW) and Fuzzy C-Means clustering (FCM) algorithms. A total of 19 brain metastatic tumors, undergone stereotactic neuro-radiosurgery, were retrospectively analyzed. A framework for the evaluation of multimodal PET/MRI segmentation is presented, considering volume…

Spectral interest points and texture extraction and fusion for identification, control and security

2018

Biometrics is an emerging technology that proposes new methods of control, identification and security. Biometric systems are often subject to risks. Face recognition is popular and several existing approaches use images in the visible spectrum. These traditional systems operating in the visible spectrum suffer from several limitations due to changes in lighting, poses and facial expressions. The methodology presented in this thesis is based on multispectral facial recognition using infrared and visible imaging, to improve the performance of facial recognition and to overcome the deficiencies of the visible spectrum. The multispectral images used in this study are obtained by fusion of visi…

Calm Down – Exploiting Sensorimotor Entrainment in Breathing Regulation Application

2011

Various phenomena in human life are related to different kinds of rhythms. Not only are our bodily functions based on rhythms, but also much of the interaction with our environment is related to them. In this study, we explore breathing regulation and how it could be supported with an interactive application. The application is based on the concept of entrainment, in which two interacting entities adjust to a common rhythm. The focus is in the design of interaction elements which support entrainment process. A user study of a prototype application is also reported in the paper. The results indicate that the approach is promising and has potential in opening new perspectives to humancomputer…

An RFID framework for multimodal service provision

2009

In recent years there has been a growing interest toward the development of pervasive and context-aware services, and RFID technology played a relevant role in the context sensing task. We propose the use of RFID technology together with a conversational agent in order to implement a multimodal information retrieval service we call SensorMesh. The information acquired from RFID tags about the nearest point of interest is processed by the conversational agent that carries a more natural interaction with the user, also exploiting a common sense ontology. The service is accessible using a multimodal browser on Personal Digital Assistants (PDAs); the browser allows the user to interact with the…

A Multimodal Guide for the Augmented Campus

2007

The use of Personal Digital Assistants (PDAs) with ad-hoc built-in information retrieval and auto-localization functionalities can help people navigating an environment in a more natural manner compared to traditional audio/visual pre-recorded guides. In this work we propose and discuss a user-friendly, multi-modal guide system for pervasive context-aware service provision within augmented environments. The proposed system is adaptable to the user needs of mobility within a given environment; it is usable on different mobile devices and in particular on PDAs, which are used as advanced adaptive HEI (human-environment interaction) interfaces. An information retrieval service is provided that…

Combining intelligent recommendation and mixed reality in itineraries for urban exploration

2017

Exploration of points of interest (POI) in urban environments is challenging for the large amount of items near or reachable by the user and for the modality hindrances due to reduced manual flexibility and competing visual attention. We propose to combine different modalities, VR, AR, haptics-audio interfaces, with intelligent recommendation based on a computational method combining different data graph overlays: social, personal and search-time user input. We integrate such features in flexible itineraries that aid different phases and aspects of exploration.