Abstract
Social media is one of the data sources that could provide more information or potential knowledge in almost any field of application. One of the main challenges of machine learning and big data is to solve the difficulty involved in the identification, classification, and, in general, the processing of all this data to extract useful information for a specific field. In this work, we propose a methodology for the detection of tourist places of interest through the combined use of images and text from social networks. For that purpose, we will be assisted by pre-trained neural networks for image classification and sentiment analysis. The result is frequency information of types of places according to a tourism-specific taxonomy combined with user sentiment indicators, which is potentially relevant information for tourism analysts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alaei, A., Stantic, B., Becken, S.: Sentiment analysis in tourism: capitalizing on big Data. J. Travel Res. 58(2), 175–191 (2019)
Domínguez, D.R., Redondo, R.P.D., Vilas, A.F., Khalifa, M.B.: Sensing the city with Instagram: clustering geolocated data for outlier detection. Expert Syst. Appl. 78, 319–333 (2017)
Giglio, S., Bertacchini, F., Bilotta, E., Pantano, P.: Using social media to identify tourism attractiveness in six Italian cities. Tourism Manage. 72(2018), 306–312 (2019)
Gomez, R., Gomez, L., Gibert, J., Karatzas, D.: Learning to learn from web data through deep semantic embeddings. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). LNCS, vol. 11134, pp. 514–529 (2019)
Li, J., Lizhi, X., Tang, L., Wang, S., Li, L.: Big data in tourism research: a literature review. Tourism Manage. 68, 301–323 (2018)
Lorla, S.: TextBlob Documentation. TextBlob, p. 69 (2020)
Lucas, L., Tomas, D., Garcia-Rodriguez, J.: Exploiting the relationship between visual and textual features in social networks for image classification with zero-shot deep learning (2021)
Lv, S.X., Peng, L., Wang, L.: Stacked autoencoder with echo-state regression for tourism demand forecasting using search query data. Appl. Soft Comput. J. 73, 119–133 (2018)
McKercher, B.: Towards a taxonomy of tourism products. Tourism Manage. 54, 196–208 (2016)
Menk, A., Sebastia, L., Ferreira, R.: Recommendation systems for tourism based on social networks: a survey. CoRR, March 2019
Mukhina, K.D., Rakitin, S.V., Visheratin, A.A.: Detection of tourists attraction points using Instagram profiles. In: Procedia Computer Science, vol. 108, pp. 2378–2382. Elsevier B.V. (2017)
Mukhina, K.D., Visheratin, A.A., Nasonov, D.: Urban events prediction via convolutional neural networks and Instagram data. In: Procedia Computer Science, vol. 156, pp. 176–184. Elsevier B.V. (2019)
Radford, A., et al.: Learning Transferable Visual Models From Natural Language Supervision. OpenAI, p. 47 (2019)
Saquete, E., Tomás, D., Moreda, P., Martínez-Barco, P., Palomar, M.: Fighting post-truth using natural language processing: a review and open challenges. Expert Syst. Appl. 141, 112943 (2020)
Zhang, K., Chen, Y., Li, C.: Discovering the tourists’ behaviors and perceptions in a tourism destination by analyzing photos’ visual content with a computer deep learning model: the case of Beijing. Tourism Manage. 75, 595–608 (2019)
Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., Oliva, A.: Learning deep features for scene recognition using places database - supplementary materials. In: NIPS 2014 Proceedings of the 27th International Conference on Neural Information Processing Systems, vol. 1, pp. 487–495 (2014)
Acknowledgement
This work was funded by the University of Alicante UAPOSTCOVID19-10 grant for “Collecting and publishing open data for the revival of the tourism sector post-COVID-19” project. We would like to thank Nvidia for their generous hardware donations that made these experiments possible.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lucas, L., Tomás, D., Garcia-Rodriguez, J. (2022). Sentiment Analysis and Image Classification in Social Networks with Zero-Shot Deep Learning: Applications in Tourism. In: Sanjurjo González, H., Pastor López, I., García Bringas, P., Quintián, H., Corchado, E. (eds) 16th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2021). SOCO 2021. Advances in Intelligent Systems and Computing, vol 1401. Springer, Cham. https://doi.org/10.1007/978-3-030-87869-6_40
Download citation
DOI: https://doi.org/10.1007/978-3-030-87869-6_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87868-9
Online ISBN: 978-3-030-87869-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)