Abstract
Sentiment analysis is one of the fields of Natural Language Processing that builds a system to recognize and extract opinions in the form of text into positive or negative sentiment. Nowadays, many researchers have developed methods that yield the best accuracy in performing analysis sentiment. Three particular models are Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU), which have deep learning architectures. CNN is used because of its ability to extract essential features from each sentence fragment, while LSTM and GRU are used because of their ability to memorize prior inputs. GRU has a more straightforward and more practical structure compared to LSTM. These models have been combined into hybrid architectures of LSTM-CNN, CNN-LSTM, and CNN-GRU. In this paper, we analyze the performance of the hybrid architectures for Indonesian sentiment analysis in e-commerce reviews. Besides all three combined models mentioned above, we consider one more combined model, which is GRU-CNN. We evaluate the performance of each model, then compare the accuracy of the standard models with the combined models to see if the combined models can improve the performance of the standard. Our simulations show that almost all of the hybrid architectures give better accuracies than the standard models. Moreover, the hybrid architecture of LSTM-CNN reaches slightly better accuracies than other hybrid architectures.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kemp, S., Moey, S.: Digital 2019 Spotlight: E-commerce in Indonesia, https://datareportal.com/reports/digital-2019-ecommerce-in-indonesia. Accessed 01 Oct 2019
Liu, B.: Sentiment analysis and opinion mining. In: Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers (2012)
Murphy, K.: Machine Learning: A Probabilistic Perspective. MIT Press, London (2012)
Devika, M.D., Sunitha, C., Ganesh, A.: Sentiment analysis: a comparative study on different approaches. Procedia Comput. Sci. 87, 44–49 (2016)
Mariel, W.C.F., Mariyah, S., Pramana, S.: Sentiment analysis: a comparison of deep learning neural network algorithm with SVM and NaÏŠve Bayes for Indonesian text (2018)
Kim, Y.: Convolutional neural networks for sentence classification. In: Association for Computational Linguistics (ACL), Doha (2014)
Hassan, A., Mahmood, A.: Deep learning for sentence classification. In: IEEE Long Island Systems, Applications and Technology Conference (LISAT), New York (2017)
Biswas, S., Chadda, E., Ahmad, F.: Sentiment analysis with gated recurrent units. In: Advances in Computer Science and Information Technology (ACSIT), India, vol. 2, no. 11, pp. 59–63 (2015)
Wang, X., Jiang, W., Luo, Z.: Combination of convolutional and recurrent neural network for sentiment analysis of short texts. In: COLING 2016 - 26th International Conference on Computational Linguistics, Osaka, pp. 2428–2437 (2016)
Sosa, P.M.: Twitter sentiment analysis using combined LSTM-CNN models. In: Academia Edu, pp. 1–9 (2017)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Zhang, A., Lipton, Z., Li, M., Smola, A.: Dive into Deep Learning (2020)
Cho, K., Merrienboer, B., van Bahdanau, D., Bengio, Y.: On the properties of neural machine translation: encoder-decoder approaches, pp. 103–111 (2015)
Wijaya, M.: Analisis Kinerja Modifikasi Model Gabungan Long Short-Term Memory dan Convolutional Neural Network untuk Analisis Sentimen Berbahasa Indonesia. Universitas Indonesia, Indonesia (2020)
Olah, C.: Understanding LSTM Networks. http://colah.github.io/posts/2015-08-Understanding-LSTMs/. Accessed 30 Oct 2019
Kostadinov, S.: Understanding GRU Networks. https://towardsdatascience.com/understanding-gru-networks-2ef37df6c9be. Accessed 31 Oct 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Gowandi, T., Murfi, H., Nurrohmah, S. (2021). Performance Analysis of Hybrid Architectures of Deep Learning for Indonesian Sentiment Analysis. In: Mohamed, A., Yap, B.W., Zain, J.M., Berry, M.W. (eds) Soft Computing in Data Science. SCDS 2021. Communications in Computer and Information Science, vol 1489. Springer, Singapore. https://doi.org/10.1007/978-981-16-7334-4_2
Download citation
DOI: https://doi.org/10.1007/978-981-16-7334-4_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-7333-7
Online ISBN: 978-981-16-7334-4
eBook Packages: Computer ScienceComputer Science (R0)