Video-Based Depression Detection Using Local Curvelet Binary Patterns in Pairwise Orthogonal Planes
International audience; Depression is an increasingly prevalent mood disorder. This is the reason why the field of computer-based depression assessment has been gaining the attention of the research community during the past couple of years. The present work proposes two algorithms for depression detection, one Frame-based and the second Video-based, both employing Curvelet transform and Local Binary Patterns. The main advantage of these methods is that they have significantly lower computational requirements, as the extracted features are of very low dimensionality. This is achieved by modifying the previously proposed algorithm which considers Three-Orthogonal-Planes, to only Pairwise-Ort…
Machine Learning Techniques for Automatic Depression Assessment
Depression is one of the most common mood disorder that is inherently related to emotions, involving bad mood, low self-esteem and loss of interest in normal pleasurable activities. The aim of this work is to develop a framework based on the dataset provided by AVEC'14 for depression assessment. The proposed work presents two different motion representation methods: a) Gabor Motion History Image (GMHI), and b) Motion History Image (MHI). Several combinations of appearance-based low level features are extracted from both motion representations. These features were further combined with statistically derived features, and used for training and testing with several machine learning techniques.…
Video-based Pain Level Assessment: Feature Selection and Inter-Subject Variability Modeling
Automatic pain level assessment, based on video features, may provide clinically-relevant, objective measures of pain intensity. In various clinical contexts accurate pain level estimation by health care personnel is challenging. This problem is compounded by considerable inter- and intra-individual variability of both perceived pain levels and of the associated facial expressions, especially at low pain levels. Thus, providing objective video-based indices for pain level assessment is a rather computationally challenging problem. In the present work both geometric and color-based features were extracted. The most informative features were identified with lasso regression, and subject varia…
Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text
International audience; Depression is a major cause of disability world-wide. The present paper reports on the results of our participation to the depression sub-challenge of the sixth Audio/Visual Emotion Challenge (AVEC 2016), which was designed to compare feature modalities ( audio, visual, interview transcript-based) in gender-based and gender-independent modes using a variety of classification algorithms. In our approach, both high and low level features were assessed in each modality. Audio features were extracted from the low-level descriptors provided by the challenge organizers. Several visual features were extracted and assessed including dynamic characteristics of facial elements…
Facial geometry and speech analysis for depression detection.
Depression is one of the most prevalent mental disorders, burdening many people world-wide. A system with the potential of serving as a decision support system is proposed, based on novel features extracted from facial expression geometry and speech, by interpreting non-verbal manifestations of depression. The proposed system has been tested both in gender independent and gender based modes, and with different fusion methods. The algorithms were evaluated for several combinations of parameters and classification schemes, on the dataset provided by the Audio/Visual Emotion Challenge of 2013 and 2014. The proposed framework achieved a precision of 94.8% for detecting persons achieving high sc…
Quantitative comparison of motion history image variants for video-based depression assessment
Abstract Depression is the most prevalent mood disorder and a leading cause of disability worldwide. Automated video-based analyses may afford objective measures to support clinical judgments. In the present paper, categorical depression assessment is addressed by proposing a novel variant of the Motion History Image (MHI) which considers Gabor-inhibited filtered data instead of the original image. Classification results obtained with this method on the AVEC’14 dataset are compared to those derived using (a) an earlier MHI variant, the Landmark Motion History Image (LMHI), and (b) the original MHI. The different motion representations were tested in several combinations of appearance-based …
Automated Characterization of Mouth Activity for Stress and Anxiety Assessment
International audience; Non-verbal information portrayed by human facial expression, apart from emotional cues also encompasses information relevant to psychophysical status. Mouth activities in particular have been found to correlate with signs of several conditions; depressed people smile less, while those in fatigue yawn more. In this paper, we present a semi-automated, robust and efficient algorithm for extracting mouth activity from video recordings based on Eigen-features and template-matching. The algorithm was evaluated for mouth openings and mouth deformations, on a minimum specification dataset of 640x480 resolution and 15 fps. The extracted features were the signals of mouth expa…
Designing a framework for assisting depression severity assessment from facial image analysis
Depression is one of the most common mental disorders affecting millions of people worldwide. Developing adjunct tools aiding depression assessment is expected to impact overall health outcomes and treatment cost reduction. To this end, platforms designed for automatic and non-invasive depression assessment could help in detecting signs of the disease on a regular basis, without requiring the physical presence of a mental health professional. Despite the different approaches that can be found in the literature, both in terms of methods and algorithms, a fully satisfactory system for the automatic assessment of depression severity has not been presented as yet. This paper describes a propose…
Automatic Assessment of Depression Based on Visual Cues: A Systematic Review
International audience; Automatic depression assessment based on visual cues is a rapidly growing research domain. The present exhaustive review of existing approaches as reported in over sixty publications during the last ten years focuses on image processing and machine learning algorithms. Visual manifestations of depression, various procedures used for data collection, and existing datasets are summarized. The review outlines methods and algorithms for visual feature extraction, dimensionality reduction, decision methods for classification and regression approaches, as well as different fusion strategies. A quantitative meta-analysis of reported results, relying on performance metrics r…
Détection de la dépression par l’analyse de la géométrie faciale et de la parole
Depression is one of the most prevalent mental disorders, burdening many people world-wide. A system with the potential of serving as a decision support system is proposed, based on novel features extracted from facial expression geometry and speech, by interpreting non-verbal manifestations of depression. The proposed system has been tested both in gender independent and gender based modes, and with different fusion methods. The algorithms were evaluated for several combinations of parameters and classification schemes, on the dataset provided by the Audio/Visual Emotion Challenge of 2013 and 2014. The proposed framework achieved a precision of 94.8% for detecting persons achieving high sc…