Abstract
Sentiment Analysis is the study of opinions produced from human written textual sources and it has become popular in recent years. The area is commonly divided into two main tasks: Document-level Sentiment Analysis and Aspect-based Sentiment Analysis. Recent advancements in Deep Learning have led to a breakthrough, reaching state-of-the-art accuracy scores for both tasks, however, little is known about their internal processing of these neural models when making predictions. Aiming for the development of more explanatory systems, we argue that Aspect-based Analysis can help deriving deep interpretation of the sentiment predicted by a Document-level Analysis, working as a proxy method. We propose a framework to verify if predictions produced by a trained Aspect-based model can be used to explain Document-level Sentiment classifications, by calculating an agreement metric between the two models. In our case study with two benchmark datasets, we achieve \(90\%\) of agreement between the models, thus showing the an Aspect-based Analysis should be favoured for the sake of explainability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Angwin, J., Larson, J., Kirchner, L., Mattu, S.: Machine bias, March 2019. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
Caliskan, A., Bryson, J., Narayanan, A.: Semantics derived automatically from language corpora contain human-like biases. Science 356, 183–186 (2017)
Clos, J., Wiratunga, N., Massie, S.: Towards explainable text classification by jointly learning lexicon and modifier terms (2017)
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. CoRR abs/1810.04805 (2018). http://arxiv.org/abs/1810.04805
Gilpin, L.H., Bau, D., Yuan, B.Z., Bajwa, A., Specter, M., Kagal, L.: Explaining explanations: an overview of interpretability of machine learning. In: 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), October 2018. https://doi.org/10.1109/dsaa.2018.00018
Goodman, B., Flaxman, S.: European union regulations on algorithmic decision-making and a “right to explanation”. AI Mag. 38, 50–57 (2017)
Huk Park, D., et al.: Multimodal explanations: Justifying decisions and pointing to the evidence. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8779–8788 (2018)
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, EMNLP 2002, vol. 10, pp. 79–86. Association for Computational Linguistics, Stroudsburg, PA, USA (2002). https://doi.org/10.3115/1118693.1118704
Pontiki, M., et al.: Semeval-2016 task 5: aspect based sentiment analysis. In: Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), pp. 19–30 (2016)
Ribeiro, M.T., Singh, S., Guestrin, C.: Why should i trust you?. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2016 (2016). https://doi.org/10.1145/2939672.2939778
Shrikumar, A., Greenside, P., Kundaje, A.: Learning important features through propagating activation differences (2017)
Sun, C., Huang, L., Qiu, X.: Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence. CoRR abs/1903.09588 (2019). http://arxiv.org/abs/1903.09588
Thet, T.T., Na, J.C., Khoo, C.S.: Aspect-based sentiment analysis of movie reviews on discussion boards. J. Inf. Sci. 36(6), 823–848 (2010). https://doi.org/10.1177/0165551510388123
Xu, F., Uszkoreit, H., Du, Y., Fan, W., Zhao, D., Zhu, J.: Explainable AI: a brief survey on history, research areas, approaches and challenges. In: International Conference on Natural Language Processing and Chinese Computing, Explainable Artificial Intelligence Workshop (2019)
Xu, H., Liu, B., Shu, L., Yu, P.S.: BERT post-training for review reading comprehension and aspect-based sentiment analysis. CoRR abs/1904.02232 (2019). http://arxiv.org/abs/1904.02232
Yang, Z., Dai, Z., Yang, Y., Carbonell, J.G., Salakhutdinov, R., Le, Q.V.: XLNet: generalized autoregressive pretraining for language understanding. CoRR abs/1906.08237 (2019). http://arxiv.org/abs/1906.08237
Zhang, L., Wang, S., Liu, B.: Deep learning for sentiment analysis: a survey. CoRR abs/1801.07883 (2018). http://arxiv.org/abs/1801.07883
Zucco, C., Liang, H., Di Fatta, G., Cannataro, M.: Explainable sentiment analysis with applications in medicine. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 1740–1747. IEEE (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
De Sousa Silveira, T., Uszkoreit, H., Ai, R. (2019). Using Aspect-Based Analysis for Explainable Sentiment Predictions. In: Tang, J., Kan, MY., Zhao, D., Li, S., Zan, H. (eds) Natural Language Processing and Chinese Computing. NLPCC 2019. Lecture Notes in Computer Science(), vol 11839. Springer, Cham. https://doi.org/10.1007/978-3-030-32236-6_56
Download citation
DOI: https://doi.org/10.1007/978-3-030-32236-6_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32235-9
Online ISBN: 978-3-030-32236-6
eBook Packages: Computer ScienceComputer Science (R0)
