6533b853fe1ef96bd12ac35b
RESEARCH PRODUCT
Quantitative comparison of motion history image variants for video-based depression assessment
Calliope-marina VazakopoulouMuhammad AwaisManolis TsiknakisManolis TsiknakisPanagiotis G. SimosAnna MaridakiFan YangAnastasia PampouchidouStelios SfakianakisKostas MariasKostas MariasFabrice MeriaudeauFabrice MeriaudeauMatthew Pediaditissubject
BiometricsComputer scienceSpeech recognitionlcsh:TK7800-836002 engineering and technologyConvolutional neural networkMotion (physics)[SPI]Engineering Sciences [physics]Image processingMachine learning0502 economics and business[ SPI ] Engineering Sciences [physics]0202 electrical engineering electronic engineering information engineeringElectrical and Electronic EngineeringCategorical variableComputingMilieux_MISCELLANEOUSLandmarkbusiness.industrylcsh:Electronics05 social sciencesAffective computingFacial image analysisPattern recognitionMotion history imageMoodSignal ProcessingPattern recognition (psychology)Depression assessment020201 artificial intelligence & image processingArtificial intelligenceF1 scorebusiness050203 business & managementInformation Systemsdescription
Abstract Depression is the most prevalent mood disorder and a leading cause of disability worldwide. Automated video-based analyses may afford objective measures to support clinical judgments. In the present paper, categorical depression assessment is addressed by proposing a novel variant of the Motion History Image (MHI) which considers Gabor-inhibited filtered data instead of the original image. Classification results obtained with this method on the AVEC’14 dataset are compared to those derived using (a) an earlier MHI variant, the Landmark Motion History Image (LMHI), and (b) the original MHI. The different motion representations were tested in several combinations of appearance-based descriptors, as well as with the use of convolutional neural networks. The F1 score of 87.4% achieved in the proposed work outperformed previously reported approaches.
year | journal | country | edition | language |
---|---|---|---|---|
2017-12-01 | EURASIP Journal on Image and Video Processing |