6533b850fe1ef96bd12a8551

RESEARCH PRODUCT

Facial geometry and speech analysis for depression detection.

Anastasia PampouchidouManolis TsiknakisKostas MariasC. M. VazakopoulouCharikleia ChatzakiFan YangPanagiotis G. SimosFabrice MeriaudeauOlympia SimantirakiAnna MaridakiMatthew Pediaditis

subject

Decision support systemFacial expressionDepressive DisorderDepressionSpeech recognition05 social sciencesNearest neighbourClassification scheme02 engineering and technologyFacial geometryBinary operationFace0502 economics and business0202 electrical engineering electronic engineering information engineeringDecision fusionHumansSpeech020201 artificial intelligence & image processingPsychologyClassifier (UML)050203 business & managementAlgorithms

description

Depression is one of the most prevalent mental disorders, burdening many people world-wide. A system with the potential of serving as a decision support system is proposed, based on novel features extracted from facial expression geometry and speech, by interpreting non-verbal manifestations of depression. The proposed system has been tested both in gender independent and gender based modes, and with different fusion methods. The algorithms were evaluated for several combinations of parameters and classification schemes, on the dataset provided by the Audio/Visual Emotion Challenge of 2013 and 2014. The proposed framework achieved a precision of 94.8% for detecting persons achieving high scores on a self-report scale of depressive symptomatology. Optimal system performance was obtained using a nearest neighbour classifier on the decision fusion of geometrical features in the gender independent mode, and audio based features in the gender based mode; single visual and audio decisions were combined with the OR binary operation.

10.1109/embc.2017.8037103https://pubmed.ncbi.nlm.nih.gov/29060147