R. Sathish
Abstract
More individuals actively express their opinions and attitudes in social media through advanced improvements such as visual content and text captions. Sentiment analysis for visuals such as images, video, and GIFs has become an emerging research trend in understanding social involvement and opinion prediction. Numerous individual researchers have obtained good progress in outcomes for text sentiment analysis and image sentiment analysis. The combination of image sentiment analysis with text caption analysis needs more research. This article presents a VGG Network-based Intermodal Sentiment Analysis Model (VGGNET-ISAM) for transferring the connection between texts to images. A mapping process is developed using the VGG Network for gathering the opinion information as numerical vectors. The Active Deep Learning (ADL) classifier is used for opinion prediction from the obtained information vectors. Simulation experiments are carried out to evaluate the proposed approach. The findings show that the model outperforms and gives better solutions with high accuracy, precision with low delay, and low error rate.
- L. Wu, M. Qi, M. Jian, and H. Zhang. 2019. Visual sentiment analysis by combining global and local information. Neural Processing Letters 1–13.Google Scholar
- E. Chu and D. Roy. 2017. Audio-visual sentiment analysis for learning emotional arcs in movies. In IEEE International Conference on Data Mining (ICDM’17) 829–834. IEEE.Google Scholar
- A. Ortis, G. M. Farinella, and S. Battiato. 2020. Survey on visual sentiment analysis. IET Image Processing 14, 8 (2020), 1440–1456.Google ScholarCross Ref
- S. Seo, S. Na, and J. Kim. 2020. HMTL: Heterogeneous modality transfer learning for audio-visual sentiment analysis. IEEE Access 8, 140426–140437.Google ScholarCross Ref
- A. Ortis, G. M. Farinella, G. Torrisi, and S. Battiato. 2020. Exploiting objective text description of images for visual sentiment analysis. Multimedia Tools and Applications 1–24.Google Scholar
- F. Huang, X. Zhang, Z. Zhao, J. Xu, and Z. Li. 2019. Image–text sentiment analysis via deep multimodal attentive fusion. Knowledge-Based Systems 167, 26–37.Google ScholarDigital Library
- F. Huang, K. Wei, J. Weng, and Z. Li. 2020. Attention-based modality-gated networks for image-text sentiment analysis. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 16, 3 (2020), 1–19. Google ScholarDigital Library
- J. Xu, F. Huang, X. Zhang, S. Wang, C. Li, Z. Li, and Y. He. 2019. Sentiment analysis of social images via hierarchical deep fusion of content and links. Applied Soft Computing 80 (2019), 387–399.Google ScholarDigital Library
- A. Ortis, G. M. Farinella, and S. Battiato. 2019. An overview on image sentiment analysis: Methods, datasets and current challenges. In ICETE 1 (2019), 296–306.Google Scholar
- M. P. Fortin, and B. Chaib-draa. 2019. Multimodal sentiment analysis: A multitask learning approach. In ICPRAM 368–376.Google Scholar
- C. Zucco, B. Calabrese, G. Agapito, P. H. Guzzi, and M. Cannataro. 2020. Sentiment analysis for mining texts and social networks data: Methods and tools. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 10, 1 (2020), e1333.Google ScholarCross Ref
- M. Taboada, J. Brooke, M. Tofiloski, K. Voll, and M. Stede. 2011. Lexicon-based methods for sentiment analysis. Computational linguistics 37, 2 (2011), 267–307. Google ScholarDigital Library
- T. O'Keefe and I. Koprinska. 2009. Feature selection and weighting methods in sentiment analysis. In Proceedings of the 14th Australasian Document Computing Symposium. Sydney, 67–74.Google Scholar
- A. Sharma, and S. Dey. 2012. Performance investigation of feature selection methods and sentiment lexicons for sentiment analysis. IJCA Special Issue on Advanced Computing and Communication Technologies for HPC Applications 3, 15–20.Google Scholar
- J. A. Morente-Molinera, G. Kou, Y. Peng, C. Torres-Albero, and E. Herrera-Viedma. 2018. Analysing discussions in social networks using group decision making methods and sentiment analysis. Information Sciences 447 (2018), 157–168.Google ScholarCross Ref
- M. Hao, C. Rohrdantz, H. Janetzko, U. Dayal, D. A. Keim, L. E. Haug, and M. C. Hsu. 2011. Visual sentiment analysis on Twitter data streams. In IEEE Conference on Visual Analytics Science and Technology (VAST’11) 277–278. IEEE.Google Scholar
- J. Yang, D. She, Y. K. Lai, P. L. Rosin, and M. H. Yang. 2018. Weakly supervised coupled networks for visual sentiment analysis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 7584–7592.Google Scholar
- J. Islam and Y. Zhang. 2016. Visual sentiment analysis for social images using transfer learning approach. In IEEE International Conferences on Big Data and Cloud Computing (BDCloud’16), Social Computing and Networking (SocialCom), Sustainable Computing and Communications (SustainCom) (BDCloud-SocialCom-SustainCom), 124–130. IEEE.Google Scholar
- J. Wang, J. Fu, Y. Xu, and T. Mei. 2016. Beyond object recognition: Visual sentiment analysis with deep coupled adjective and noun neural networks. In IJCAI, 3484–3490. Google ScholarDigital Library
- E. Chu and D. Roy. 2017. Audio-visual sentiment analysis for learning emotional arcs in movies. In IEEE International Conference on Data Mining (ICDM’17) 829–834. IEEE.Google Scholar
- O. Habimana, Y. Li, R. Li, X. Gu, and G. Yu. 2020. Sentiment analysis using deep learning approaches: An overview. Science China Information Sciences 63, 1 (2020), 1–36.Google ScholarCross Ref
Index Terms
- Intermodal Sentiment Analysis for Images with Text Captions Using the VGGNET Technique
Recommendations
Multimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges
Sentiment analysis has come long way since it was introduced as a natural language processing task nearly 20 years ago. Sentiment analysis aims to extract the underlying attitudes and opinions toward an entity. It has become a powerful tool used by ...
Joint sentiment/topic model for sentiment analysis
CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge managementSentiment analysis or opinion mining aims to use automated tools to detect subjective information such as opinions, attitudes, and feelings expressed in text. This paper proposes a novel probabilistic modeling framework based on Latent Dirichlet ...
Topic sentiment change analysis
MLDM'11: Proceedings of the 7th international conference on Machine learning and data mining in pattern recognitionPublic opinions on a topic may change over time. Topic Sentiment change analysis is a new research problem consisting of two main components: (a) mining opinions on a certain topic, and (b) detect significant changes of sentiment of the opinions on the ...
Comments