Chenhao Lin
ABSTRACT
More than 300 million people have been affected by depression all over the world. Due to the medical equipment and knowledge limitations, most of them are not diagnosed at the early stages. Recent work attempts to use social media to detect depression since the patterns of opinions and thoughts expression of the posted text and images, can reflect users' mental state to some extent. In this work, we design a system dubbed SenseMood to demonstrate that the users with depression can be efficiently detected and analyzed by using proposed system. A deep visual-textual multimodal learning approach has been proposed to reveal the psychological state of the users on social networks. The posted images and tweets data from users with/without depression on Twitter have been collected and used for depression detection. CNN-based classifier and Bert are applied to extract the deep features from the pictures and text posted by users respectively. Then visual and textual features are combined to reflect the emotional expression of users. Finally our system classifies the users with depression and normal users through a neural network and the analysis report is generated automatically.
- Oluwaseun Ajao, Deepayan Bhowmik, and Shahrzad Zargari. 2019. Sentiment aware fake news detection on online social networks. In ICASSP 2019--2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2507--2511.Google Scholar
Cross Ref
- Tuka Al Hanai, Mohammad M Ghassemi, and James R Glass. 2018. Detecting Depression with Audio/Text Sequence Modeling of Interviews.. In Interspeech. 1716--1720.Google Scholar
- Munmun De Choudhury, Michael Gamon, Scott Counts, and Eric Horvitz. 2013. Predicting depression via social media. In Seventh international AAAI conference on weblogs and social media.Google Scholar
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).Google Scholar
- Stephanie Gillespie, Elliot Moore, Jacqueline Laures-Gore, Matthew Farina, Scott Russell, and Yash-Yee Logan. 2017. Detecting stress and depression in adults with aphasia through speech analysis. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 5140--5144.Google ScholarDigital Library
- Pengwei Hu, Tiantian He, Keith CC Chan, and Henry Leung. 2017. Deep Fusion of Multiple Networks for Learning Latent Social Communities. In 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI). IEEE, 765--771.Google Scholar
- Pengwei Hu, Zhaomeng Niu, Tiantian He, and Keith CC Chan. 2018. Learning Deep Representations in Large Integrated Network for Graph Clustering. In 2018 IEEE First International Conference on Artificial Intelligence and Knowledge Engineering (AIKE). IEEE, 101--105.Google Scholar
- Po-Yao Huang, Junwei Liang, Jean-Baptiste Lamare, and Alexander G Hauptmann. 2018. Multimodal filtering of social media for temporal monitoring and event analysis. In Proceedings of the 2018 ACMon International Conference on Multimedia Retrieval. 450--457.Google ScholarDigital Library
- Felice N Jacka and Nicola J Reavley. 2014. Prevention of mental disorders: evidence, challenges and opportunities.Google Scholar
- Kurt Kroenke, TaraWStrine, Robert L Spitzer, Janet BW Williams, Joyce T Berry, and Ali H Mokdad. 2009. The PHQ-8 as a measure of current depression in the general population. Journal of affective disorders 114, 1--3 (2009), 163--173.Google ScholarCross Ref
- Genevieve Lam, Huang Dongyan, and Weisi Lin. 2019. Context-aware Deep Learning for Multi-modal Depression Detection. In ICASSP 2019--2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 3946--3950.Google Scholar
- Chenhao Lin and Ajay Kumar. 2018. A CNN-based framework for comparison of contactless to contact-based fingerprints. IEEE Transactions on Information Forensics and Security 14, 3 (2018), 662--676.Google ScholarCross Ref
- Zhun Liu, Ying Shen, Varun Bharadhwaj Lakshminarasimhan, Paul Pu Liang, Amir Zadeh, and Louis-Philippe Morency. 2018. Efficient low-rank multimodal fusion with modality-specific factors. arXiv preprint arXiv:1806.00064 (2018).Google Scholar
- Chandler May, Alex Wang, Shikha Bordia, Samuel R Bowman, and Rachel Rudinger. 2019. On measuring social biases in sentence encoders. arXiv preprint arXiv:1903.10561 (2019).Google Scholar
- Seungwhan Moon, Leonardo Neves, and Vitor Carvalho. 2018. Multimodal named entity disambiguation for noisy social media posts. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2000--2008.Google ScholarCross Ref
- Ricardo F Muñoz, William R Beardslee, and Yan Leykin. 2012. Major depression can be prevented. American Psychologist 67, 4 (2012), 285.Google ScholarCross Ref
- Ricardo F Munoz, Patricia J Mrazek, and Robert J Haggerty. 1996. Institute of Medicine report on prevention of mental disorders: summary and commentary. American Psychologist 51, 11 (1996), 1116.Google ScholarCross Ref
- Hyeonseob Nam, Jung-Woo Ha, and Jeonghee Kim. 2017. Dual attention networks for multimodal reasoning and matching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 299--307.Google ScholarCross Ref
- Minsu Park, DavidWMcDonald, and Meeyoung Cha. 2013. Perception differences between the depressed and non-depressed users in twitter. In Seventh International AAAI Conference on Weblogs and Social Media.Google Scholar
- A Picardi, I Lega, L Tarsitani, M Caredda, G Matteucci, MP Zerella, R Miglio, A Gigantesco, M Cerbo, A Gaddini, et al. 2016. A randomised controlled trial of the effectiveness of a program for early detection and treatment of depression in primary care. Journal of affective disorders 198 (2016), 96--101.Google ScholarCross Ref
- Andrew G Reece and Christopher M Danforth. 2017. Instagram photos reveal predictive markers of depression. EPJ Data Science 6, 1 (2017), 15.Google ScholarCross Ref
- Guangyao Shen, Jia Jia, Liqiang Nie, Fuli Feng, Cunjun Zhang, Tianrui Hu, Tat- Seng Chua, and Wenwu Zhu. 2017. Depression Detection via Harvesting Social Media: A Multimodal Dictionary Learning Solution.. In IJCAI. 3838--3844.Google Scholar
- Tiancheng Shen, Jia Jia, Guangyao Shen, Fuli Feng, Xiangnan He, Huanbo Luan, Jie Tang, Thanassis Tiropanis, Tat-Seng Chua, and Wendy Hall. 2018. Cross- Domain Depression Detection via Harvesting Social Media.. In IJCAI. 1611--1617.Google Scholar
- Melissa N Stolar, Margaret Lech, and Nicholas B Allen. 2015. Detection of depression in adolescents based on statistical modeling of emotional influences in parent-adolescent conversations. In 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 987--991.Google ScholarCross Ref
- Andrew Yates, Arman Cohan, and Nazli Goharian. 2017. Depression and self harm risk assessment in online forums. arXiv preprint arXiv:1709.01848 (2017).Google Scholar
- Shumei Zhang, Jia Jia, and Yishuang Ning. 2017. Inferring emotions from heterogeneous social media data: A Cross-media Auto-Encoder solution. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2891--2895.Google ScholarDigital Library
Index Terms
- SenseMood: Depression Detection on Social Media
Recommendations
A textual-based featuring approach for depression detection using machine learning classifiers and social media texts
AbstractDepression is one of the leading causes of suicide worldwide. However, a large percentage of cases of depression go undiagnosed and, thus, untreated. Previous studies have found that messages posted by individuals with major depressive ...
Highlights- Depression is among the most prevalent mental disorders that can lead to suicide.
Improving Depression Classification in Social Media Text with Transformer Ensembles
SOICT '23: Proceedings of the 12th International Symposium on Information and Communication TechnologyDepression is an emotional disorder and it can arise in each of us individually. In the era of the Fourth Industrial Revolution, social media platforms provide an opportunity for people to share their thoughts and feelings, which may reveal early signs ...
Harnessing emotions for depression detection
AbstractHuman emotions using textual cues, speech patterns, and facial expressions can give insight into their mental state. Although there are several uni-modal datasets for emotion recognition, there are very few labeled datasets for multi-modal ...
Comments