Mondher Bouazizi
ABSTRACT
Over the last years, more and more attention has been given by the researchers towards dementia diagnosis using computational approaches applied on speech samples given by dementia patients. With the progress in the field of Deep Learning (DL) and Natural Language Processing (NLP), techniques of text classification using these techniques that are derived from fields such as sentiment analysis have been applied for dementia detection. However, despite the relative success in these techniques, the two tasks (i.e., sentiment analysis and dementia detection) have major differences, leading us to believe that adjustments need to be made to make the detection more accurate. In the current paper, we use transfer learning applied on a common language model. Unlike conventional work, where the text is stripped from stop words, we address the idea of exploiting the stop words themselves, as they embed non-context related information that could help identify dementia. For this sake, we prepare 3 different models: a model processing only context words, a model stop words with patterns of part-of-speech sequences, and a model including both. Through experiments, we show that both grammar and vocabulary contribute equally to the classification: the first model reaches an accuracy equal to 70.00%, the second model reaches an accuracy equal to 76.15%, and the third model reaches an accuracy equal to 81.54%.
- Guendalina Bonifacio and Giovanna Zamboni. 2016. Brain imaging in dementia. Postgraduate medical journal 92, 1088 (2016), 333–340.Google Scholar
- Mondher Bouazizi, Natsuho Niida, and Tomoaki Ohtsuki. 2021. All-in-One Hate Speech Detectors May not be what You Want. In 2021 The 4th International Conference on Software Engineering and Information Management. 165–170.Google ScholarDigital Library
- Mondher Bouazizi and Tomoaki Ohtsuki. 2017. A pattern-based approach for multi-class sentiment analysis in Twitter. IEEE Access 5(2017), 20617–20639.Google ScholarCross Ref
- Edward L Campbell, Laura Docío-Fernández, Javier Jiménez Raboso, and Carmen García-Mateo. 2020. Alzheimer’s Dementia Detection from Audio and Text Modalities. arXiv preprint arXiv:2008.04617(2020).Google Scholar
- Trevor Cohen and Serguei Pakhomov. 2020. A Tale of Two Perplexities: Sensitivity of Neural Language Models to Lexical Retrieval Deficits in Dementia of the Alzheimer’s Type. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. ACM, 1946–1957.Google ScholarCross Ref
- Knut Engedal, Anne Brækhus, Ole A Andreassen, and Per Hj Nakstad. 2012. Diagnosis of dementia–automatic quantification of brain structures. Tidsskrift for Den norske legeforening 132, 15 (Aug. 2012), 1747–51.Google Scholar
- Andres Garcia-Silva, Cristian Berrio, and Jose Manuel Gomez-Perez. 2021. Understanding Transformers for Bot Detection in Twitter. arXiv preprint arXiv:2104.06182(2021).Google Scholar
- David S Geldmacher and Peter J Whitehouse. 1996. Evaluation of dementia. New England Journal of Medicine 335, 5 (1996), 330–336.Google ScholarCross Ref
- Hugh C Hendrie. 1998. Epidemiology of dementia and Alzheimer’s disease. The American Journal of Geriatric Psychiatry 6, 2 (1998), S3–S18.Google ScholarCross Ref
- Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh. 2006. A fast learning algorithm for deep belief nets. Neural computation 18, 7 (2006), 1527–1554.Google ScholarDigital Library
- Jeremy Howard and Sebastian Ruder. 2018. Universal Language Model Fine-tuning for Text Classification. 328–339. https://doi.org/10.18653/v1/P18-1031Google Scholar
- Georgina M Jackson, Rachel Swainson, Dominic Mort, Masud Husain, and Stephen R Jackson. 2009. Attention, competition, and the parietal lobes: insights from Balint’s syndrome. Psychological research 73, 2 (2009), 263–270.Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012), 1097–1105.Google Scholar
- Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278–2324.Google ScholarCross Ref
- Jinchao Li, Jianwei Yu, Zi Ye, Simon Wong, Manwai Mak, Brian Mak, Xunying Liu, and Helen Meng. 2021. A comparative study of acoustic and linguistic features classification for alzheimer’s disease detection. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 6423–6427.Google ScholarCross Ref
- Karmele Lopez-de Ipiña, Jesús B Alonso, Jordi Solé-Casals, Nora Barroso, Patricia Henriquez, Marcos Faundez-Zanuy, Carlos M Travieso, Miriam Ecay-Torres, Pablo Martinez-Lage, and Harkaitz Eguiraun. 2015. On automatic diagnosis of Alzheimer’s disease based on spontaneous speech analysis and emotional temperature. Cognitive Computation 7, 1 (2015), 44–55.Google ScholarCross Ref
- Saturnino Luz, Sofia de la Fuente, and Pierre Albert. 2018. A method for analysis of patient speech in dialogue for dementia detection. arXiv preprint arXiv:1811.09919(2018).Google Scholar
- Brian MacWhinney. 1999. TalkBank. Recuperado de http://talkbank.org(1999).Google Scholar
- Stephen Merity, Nitish Shirish Keskar, and Richard Socher. 2017. Regularizing and optimizing LSTM language models. arXiv preprint arXiv:1708.02182(2017).Google Scholar
- Bahman Mirheidari, Daniel Blackburn, Traci Walker, Markus Reuber, and Heidi Christensen. 2019. Dementia detection using automatic analysis of conversations. Computer Speech & Language 53 (2019), 65–79.Google ScholarCross Ref
- JT O’brien. 2007. Role of imaging techniques in the diagnosis of dementia. The British journal of radiology 80, special_issue_2(2007), S71–S77.Google Scholar
- Akane Oyama, Shuko Takeda, Yuki Ito, Tsuneo Nakajima, Yoichi Takami, Yasushi Takeya, Koichi Yamamoto, Ken Sugimoto, Hideo Shimizu, Munehisa Shimamura, Taiichi Katayama, Hiromi Rakugi, and Ryuichi Morishita. 2019. Novel Method for Rapid Assessment of Cognitive Impairment Using High-Performance Eye-Tracking Technology. Scientific Reports 9, 1 (10 Sep 2019), 12932. https://doi.org/10.1038/s41598-019-49275-xGoogle Scholar
- Martin James Prince, Anders Wimo, Maelenn Mari Guerchet, Gemma Claire Ali, Yu-Tzu Wu, and Matthew Prina. 2015. World Alzheimer Report 2015-The Global Impact of Dementia: An analysis of prevalence, incidence, cost and trends. (2015).Google Scholar
- Aharon Satt, Alexander Sorin, Orith Toledo-Ronen, Oren Barkan, Ioannis Kompatsiaris, Athina Kokonozi, and Magda Tsolaki. 2013. Evaluation of speech-based protocol for detection of early-stage dementia.. In Interspeech. 1692–1696.Google Scholar
- Daisaku Shibata, Kaoru Ito, Hiroyuki Nagai, Taro Okahisa, Ayae Kinoshita, and Eiji Aramaki. 2018. Idea density in Japanese for the early detection of dementia based on narrative speech. PloS one 13, 12 (2018), e0208418.Google ScholarCross Ref
- Calvin Thomas, Vlado Keselj, Nick Cercone, Kenneth Rockwood, and Elissa Asp. 2005. Automatic detection and rating of dementia of Alzheimer type through lexical analysis of spontaneous speech. In IEEE International Conference Mechatronics and Automation, 2005, Vol. 3. IEEE, 1569–1574.Google ScholarCross Ref
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998–6008.Google Scholar
- Konstantine K Zakzanis, Simon J Graham, and Zachariah Campbell. 2003. A meta-analysis of structural and functional brain imaging in dementia of the Alzheimer’s type: a neuroimaging profile. Neuropsychology review 13, 1 (2003), 1–18.Google Scholar
- Chuheng Zheng, Mondher Bouazizi, and Tomoaki Ohtsuki. 2021. Dementia Detection Using Two Perplexity Methods with Part-of-Speech Tags. In 2021 International Conference on Emerging Technologies for Communications.Google Scholar
Recommendations
Exploiting linguistic information from Nepali transcripts for early detection of Alzheimer's disease using natural language processing and machine learning techniques
Highlights- A novel manually annotated Alzheimer's disease dataset for low resource language i.e., Nepalese, consisting of 168 Alzheimer's disease and 98 control normal patients is presented. The dataset is publicly available for research community;.
AbstractAlzheimer's disease (AD) is considered as progressing brain disease, which can be slowed down with the early detection and proper treatment by identifying the early symptoms. Language change serves as an early sign that a patient's cognitive ...
Exploring the limits of transfer learning with a unified text-to-text transformer
Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has given rise to a ...
Transfer learning helps to improve the accuracy to classify patients with different speech disorders in different languages
Highlights- We use transfer learning to classify speech from patients with Parkinson’s and Huntington’s disease, in different languages.
AbstractPatients suffering from neurodegenerative disorders such as Parkinson’s or Huntington’s disease exhibit speech impairments that affect their communication capabilities. The automatic assessment of the speech of the patients allows to ...
Comments