Abstract
Depression is the most common psychiatric disorder. Traditional depression detection methods almost rely on structured scales and clinical opinions, which carry the risk of subjective judgment. In light of this, we investigate the potential of employing emotional images as stimuli for depression detection. Our proposed method is the first to utilize pupil dilation, blink patterns, and eye movements as features for depression detection. Notably, we introduce a comprehensive set of strategies for extracting visual cognitive features, validating the efficacy of the pupil emotion response theory and blink emotion response theory. Finally, we train a Support Vector Machine (SVM) classifier to differentiate between depressed and normal subjects, achieving an impressive accuracy of 89.5%, which is higher than other state-of-the-art methods in automatic depression detection.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Drysdale, A.T., et al.: Resting-state connectivity biomarkers define neurophysiological subtypes of depression. Nat. Med. 23(1), 28–38 (2017)
Eizenman, M., et al.: A naturalistic visual scanning approach to assess selective attention in major depressive disorder. Psychiatry Res. 118(2), 117–128 (2003)
Giannakakis, G., et al.: Stress and anxiety detection using facial cues from videos. Biomed. Signal Process. Control 31, 89–101 (2017)
Gilboa, E., Gotlib, I.H.: Cognitive biases and affect persistence in previously dysphoric and never-dysphoric individuals. Cogn. Emotion 11(5–6), 517–538 (1997)
Graham, J.R.: MMPI-2: Assessing Personality and Psychopathology. Oxford University Press (1990)
Hedlund, S., Rude, S.S.: Evidence of latent depressive schemas in formerly depressed individuals. J. Abnorm. Psychol. 104(3), 517 (1995)
Kellough, J.L., Beevers, C.G., Ellis, A.J., Wells, T.T.: Time course of selective attention in clinically depressed young adults: an eye tracking study. Behav. Res. Ther. 46(11), 1238–1243 (2008)
Li, W., Ma, H., Wang, X., Shi, D.: Features derived from behavioral experiments to distinguish mental healthy people from depressed people. In: The 11th IASTED International Conference on Biomedical Engineering. ACTAPRESS (2014)
Lu, S., et al.: Attentional bias scores in patients with depression and effects of age: a controlled, eye-tracking study. J. Int. Med. Res. 45(5), 1518–1527 (2017)
Mackintosh, J., Kumar, R., Kitamura, T.: Blink rate in psychiatric illness. Br. J. Psychiatry 143(1), 55–57 (1983)
Newson, J.J., Thiagarajan, T.C.: EEG frequency bands in psychiatric disorders: a review of resting state studies. Front. Hum. Neurosci. 12, 521 (2019)
WHO Organization: World mental health report: transforming mental health for all. World mental health report: transforming mental health for all (2022)
Shen, R., Zhan, Q., Wang, Y., Ma, H.: Depression detection by analysing eye movements on emotional images. In: ICASSP 2021–2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 7973–7977. IEEE (2021)
Li, R., Ma, H., Wang, R., Ding, J.: Device-adaptive 2D gaze estimation: a multi-point differential framework. In: Peng, Y., Hu, S.-M., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds.) ICIG 2021. LNCS, vol. 12889, pp. 485–497. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87358-5_39
Siegle, G.J., Steinhauer, S.R., Carter, C.S., Ramel, W., Thase, M.E.: Do the seconds turn into hours? Relationships between sustained pupil dilation in response to emotional information and self-reported rumination. Cogn. Ther. Res. 27(3), 365–382 (2003)
Skowron, K., et al.: The role of psychobiotics in supporting the treatment of disturbances in the functioning of the nervous system-a systematic review. Int. J. Mol. Sci. 23(14), 7820 (2022)
Steidtmann, D., Ingram, R.E., Siegle, G.J.: Pupil response to negative emotional information in individuals at risk for depression. Cogn. Emot. 24(3), 480–496 (2010)
Zeng, S., Niu, J., Zhu, J., Li, X.: A study on depression detection using eye tracking. In: Tang, Y., Zu, Q., Rodríguez García, J.G. (eds.) HCC 2018. LNCS, vol. 11354, pp. 516–523. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15127-0_52
Zhu, J., et al.: An improved classification model for depression detection using EEG and eye tracking data. IEEE Trans. Nanobiosci. 19(3), 527–537 (2020)
Acknowledgment
This work was supported by the National Nature Science Foundation of China (No. U20B2062 and No. 62227801), Central Government Guided Local Science and Technology Development Project (22-1-3-11-zyyd-nsh), the R &D Program of CAAC Key Laboratory of Flight Techniques and Flight Safety (NO. FZ2021ZZ05), and the Interdisciplinary Research Project for Young Teachers of USTB (Fundamental Research Funds for the Central Universities) (No. FRF-IDRY-21-001).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, R., Wang, H., Hu, Y., Wei, L., Ma, H. (2024). Multi-source Information Fusion for Depression Detection. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14429. Springer, Singapore. https://doi.org/10.1007/978-981-99-8469-5_41
Download citation
DOI: https://doi.org/10.1007/978-981-99-8469-5_41
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8468-8
Online ISBN: 978-981-99-8469-5
eBook Packages: Computer ScienceComputer Science (R0)