Abstract
Convolutional Neural Network (CNN) has gained considerable attention in many Natural Language Processing applications including sentiment analysis task. A typical CNN model usually is made up of several convolutional and pooling layers. In this paper, our aim is to acquire detailed understanding into different type of pooling function by directly differentiate them on a same architecture layers for sentiment analysis tasks. These insights should prove useful for future development of pooling function in CNN models for sentiment analysis task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sun S, Luo C, Chen J (2017) A review of natural language processing techniques for opinion mining systems. Inf Fusion 36:10–25
Wu Z, Dai X-Y, Yin C, Huang S, Chen J (2018) Improving review representations with user attention and product attention for sentiment classification. In: Thirty-second AAAI conference on artificial intelligence
Yaqub U, Chun S, Atluri V, Vaidya J (2017) Sentiment based analysis of tweets during the us presidential elections. In: Proceedings of the 18th annual international conference on digital government research. ACM, pp 1–10
Anandarajan M, Hill C, Nolan T (2019) Sentiment analysis of movie reviews using R. In: Practical text analytics. Springer, pp 193–220
Ramanathan V, Meyyappan T (2019) Twitter text mining for sentiment analysis on people’s feedback about oman tourism. In: 2019 4th MEC international conference on big data and smart city (ICBDSC). IEEE, pp 1–5
Serrano-Guerrero J, Olivas JA, Romero FP, Herrera-Viedma E (2015) Sentiment analysis: a review and comparative analysis of web services. Inf Sci 311:18–38
Goswami S, Nandi S, Chatterjee S (2019) Sentiment analysis based potential customer base identification in social media. In: Contemporary advances in innovative and applicable information technology. Springer, pp 237–243
Rodríguez A, Argueta C, Chen Y-L (2019) Automatic detection of hate speech on facebook using sentiment and emotion analysis. In: 2019 international conference on artificial intelligence in information and communication (ICAIIC). IEEE, pp 169–174
Zhang Y-D, Dong Z, Chen X, Jia W, Du S, Muhammad K, Wang S-H (2019) Image based fruit category classification by 13-layer deep convolutional neural network and data augmentation. Multimed Tools Appl 78:3613–3632
Geetharamani G, Pandian A (2019) Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Comput Electr Eng 76:323–338
Akiyama T, Kobayashi Y, Kishigami J, Muto K (2018) CNN-based boat detection model for alert system using surveillance video camera. In: 2018 IEEE 7th global conference on consumer electronics (GCCE). IEEE, pp 669–670
Kim H, Kim Y, Kim SJ, Lee I (2018) Building emotional machines: recognizing image emotions through deep neural networks. IEEE Trans Multimedia 20:2980–2992
Dhall A, Kaur A, Goecke R, Gedeon T (2018) Emotiw 2018: audio-video, student engagement and group-level affect prediction. In: Proceedings of the 2018 on international conference on multimodal interaction. ACM, pp 653–656
Ceruti C, Cuculo V, D’Amelio A, Grossi G, Lanzarotti R (2017) Taking the hidden route: deep mapping of affect via 3D neural networks. In: International conference on image analysis and processing. Springer, pp 189–196
Young T, Hazarika D, Poria S, Cambria E (2018) Recent trends in deep learning based natural language processing. ieee Comput Intell Mag 13:55–75
Lai S, Xu L, Liu K, Zhao J (2015) Recurrent convolutional neural networks for text classification. In: Twenty-ninth AAAI conference on artificial intelligence
Kim Y (2014) Convolutional neural networks for sentence classification. arXiv:1408.5882
Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. arXiv:1404.2188
Dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: technical papers, pp 69–78
Xu F, Zhang X, Xin Z, Yang A (2019) Investigation on the Chinese text sentiment analysis based on convolutional neural networks in deep learning. Comput Mater Contin 58(3):697–709
Liao S, Wang J, Yu R, Sato K, Cheng Z (2017) CNN for situations understanding based on sentiment analysis of twitter data. Procedia Comput Sci 111:376–381
Li Q, Jin Z, Wang C, Zeng DD (2016) Mining opinion summarizations using convolutional neural networks in Chinese microblogging systems. Knowl-Based Syst 107:289–300
Abid F, Alam M, Yasir M, Li C (2019) Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter. Futur Gener Comput Syst 95:292–308
Scherer D, Müller A, Behnke S (2010) Evaluation of pooling operations in convolutional architectures for object recognition. In: International conference on artificial neural networks. Springer, pp. 92–101
Wang Y, Li J, Metze F (2019) A comparison of five multiple instance learning pooling functions for sound event detection with weak labeling. In: ICASSP 2019-2019 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 31–35
Wang X, Wang L, Qiao Y (2012) A comparative study of encoding, pooling and normalization methods for action recognition. In: Asian conference on computer vision. Springer, pp 572–585
Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J (2018) Recent advances in convolutional neural networks. Pattern Recogn 77:354–377
Severyn A, Moschitti A (2015) Learning to rank short text pairs with convolutional deep neural networks. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 373–382
Williams T, Li R (2018) Wavelet pooling for convolutional neural networks
Zeiler MD, Fergus R (2013) Stochastic pooling for regularization of deep convolutional neural networks. arXiv:1301.3557
Google Colaboratory. https://colab.research.google.com/
Carneiro T, Da Nóbrega RVM, Nepomuceno T, Bian G-B, De Albuquerque VHC, Reboucas Filho PP (2018) Performance analysis of google colaboratory as a tool for accelerating deep learning applications. IEEE Access 6:61677–61685
Maas AL, Daly RE, Pham PT, Huang D, Ng AY, Potts C (2011) Learning word vectors for sentiment analysis. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, vol 1. Association for Computational Linguistics, pp 142–150
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Samat, N.A., Salleh, M.N.M., Ali, H. (2020). The Comparison of Pooling Functions in Convolutional Neural Network for Sentiment Analysis Task. In: Ghazali, R., Nawi, N., Deris, M., Abawajy, J. (eds) Recent Advances on Soft Computing and Data Mining. SCDM 2020. Advances in Intelligent Systems and Computing, vol 978. Springer, Cham. https://doi.org/10.1007/978-3-030-36056-6_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-36056-6_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36055-9
Online ISBN: 978-3-030-36056-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)