Abstract
As an increasingly larger number of users partake in Facebook, the images shared and posted by user in Facebook provide a richer background to build a more accurate recommendation system. In this paper, we propose an Intelligent Recommendation System for Travelers’ Preferences (IRSTP) based on the conceptualization of the travel user’s destination based on their activities of sharing visual data and locations through social network. In this system, we performed a Deep Neural Network Architecture transferred on Places356 database to extract important concepts found in the shared visual images. Then, we carried out an inference system based on crisp (DOVUIS) and fuzzy ontology (DFOVUIS) to take into account some ambiguity in Decision making. Both proposed ontologies are tested and evaluated on collected Sudanese Database. The User interest architecture based on Convolutional Neural Network is used for tuning search in the IRSTP recommendation system. The Fuzzy ontology performs well than the crisp inference system in order to personalize the recommendation based on the profile outputted from this ontology. We achieve an accuracy of 94.22\% on the Sudanese database to classify the topic of user interest among 9 classes Food (98.7%), Nature (98.9%), History (80.4%), DIY and Craft (98.0%), Celebrities (87.3%), Architectures (98.6%), Events (95.4%), Holydays (93.9%) and Art (87.0%). These topics are considered from the Facebook generic topics.
Similar content being viewed by others
References
Alzubaidi L, Zhang J, Humaidi AJ et al (2021) Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J Big Data 8:53. https://doi.org/10.1186/s40537-021-00444-8
Benkaddour FZ, Taghezout N, Kaddour-Ahmed FZ, Hammadi I (2018) An Adapted Approach for User Profiling in a Recommendation System: Application to Industrial Diagnosis, International Journal of Interactive Multimedia and Artificial Intelligence
Cao L, Luo J, Gallagher A, Jin X, Han J, Huang TS (2010) in 2010 IEEE international conference on acoustics, Speech and Signal Processing, 2274–2277
Choi C, Cho M, Kang E-Y, Kim P (2006) in 2006 8th International Conference Advanced Communication Technology, 1, 1, 624–627
Choi C, Cho M, Choi J, Hwang M, Park J, Kim P (2009) in 2009 Third Asia International Conference on Modelling Simulation, pp. 637–642
Dhaware M, Vanwari P (2020) A Tourism and Travel Recommendation System Based on User-Location Vector. In: Kumar A., Paprzycki M., Gunjan V. (eds) ICDSMLA 2019. Lecture Notes in Electrical Engineering, 601. Springer, Singapore
Feng H, Qian X (2013) in Pacific-Rim Conference on Multimedia (Springer), 730–739
Feng H, Qian X (2014) Mining user-contributed photos for personalized product recommendation, Neurocomputing 129, 409, https://doi.org/10.1016/j.neucom.2013.09.018, http://www.sciencedirect.com/science/article/pii/S0925231213009363
Girshick R, Donahue J, Darrell T, Malik J (2014) in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Guarino N, Giaretta P (1995) Ontologies and Knowledge bases: towards a terminological clarification. In N. MARS (Ed.) Towards Very Large Knowledge Bases: Knowledge Building and Knowledge Sharing. IOS Press, 25–32
Guo Y, Liu Y, Oerlemans A, Lao S, Wu S, Lew MS, Deep learning for visual understanding: A review, Neurocomputing 187, 27 (2016). https://doi.org/10.1016/j.neucom.2015.09.116, http://www.sciencedirect.com/science/article/pii/S0925231215017634. Recent Developments on Deep Big Vision
Hong L, Doumith AS, Davison BD (2013) in Proceedings of the Sixth ACM International Conference on Web Search and Data Mining (Association for Computing Machinery, New York, NY, USA), WSDM ‘13, 557–566, https://doi.org/10.1145/2433396.2433467
Itoga H, Washizawa Y, Urakami Y (2018) Eeg based automatic music recommendation system using ranking deep artificial neural network. Pathophysiology 25(3):207
Jannach D, Zanker M, Jessenitschnig M (2010) in Tourism informatics: Visual travel recommender systems, social communities, and user interface design (IGI Global), 38–53
Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) in Proceedings of the 22nd ACM International Conference on Multimedia (Association for Computing Machinery, New York, NY, USA), MM ‘14, 675–678. https://doi.org/10.1145/2647868.2654889
Kesorn K, Juraphanthong W, Salaiwarakul A (2017) Personalized attraction recommendation system for tourists through check-in data. IEEE access 5:26703–26721
J.Y. Kim, K. Collins-Thompson, P.N. Bennett, S.T. Dumais (2012) in Proceedings of the Fifth ACM International Conference on Web Search and Data Mining (Association for Computing Machinery, New York, NY, USA), WSDM ‘12, 213–222, https://doi.org/10.1145/2124295.2124323
Lazzez O, Ouarda W, Alimi AM (2016) in International Conference on Intelligent Systems Design and Applications (Springer), 206–215
Lazzez O, Ouarda W, Alimi AM (2016) in International Conference on Hybrid Intelligent Systems (Springer), 527–538
Lazzez O, Ouarda W, Alimi AM (2018) Deepvisinterests: Cnn-ontology prediction of users interests from social images, arXiv preprint arXiv:1811.10920
Li Q, Zheng Y, Xie X, Chen Y, Liu W, Ma WY (2008) in Proceedings of the 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (Association for Computing Machinery, New York, NY, USA), GIS ‘08, https://doi.org/10.1145/1463434.1463477.
Li R, Tapaswi M, Liao R, Jia J, Urtasun R, Fidler S (2017) in The IEEE International Conference on Computer Vision (ICCV)
Logesh R, Subramaniyaswamy V (2019) Exploring hybrid recommender systems for personalized travel applications. In Cognitive informatics and soft computing (pp. 535–544). Springer, Singapore
Lovato P, Perina A, Cheng DS, Segalin C, Sebe N, Cristani M (2013) in 2013 IEEE International Conference on Image Processing, 2892–2896
Mac Aodha O, Su S, Chen Y, Perona P, Yue Y (2018) in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Memon I, Chen L, Majid A, Lv M, Hussain I, Chen G (2015) Travel recommendation using geo-tagged photos in social media for tourist. Wirel Pers Commun 80(4):1347
Middleton S, Shadbolt N, De Roure D (2004) Ontological user profiling in recommender systems. ACM Trans Inf Syst 22:54–88. https://doi.org/10.1145/963770.963773
Monay F, Quelhas P, Gatica-Perez D, Odobez J (2015) Constructing visual models with a latent space approach, latent structure and feature selection. Lect Notes Comput Sci 3940:115
Murillo AC, Kwak IS, Bourdev L, Kriegman D, Belongie S (2012) in 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 28–35
Noguera JM, Barranco MJ, Segura RJ, Martínez L (2012) A mobile 3d-gis hybrid recommender system for tourism, Information Sciences 215, 37, https://doi.org/10.1016/j.ins.2012.05.010, http://www.sciencedirect.com/science/article/pii/S0020025512003544
Ochoa JL, Hernández-Alcaraz ML, Almela A, Valencia-García R (2011) in Proceedings of the 3rd International Conference on Computer Modeling and Simulation, held at Mumbai, India. Chengdu: Institute of Electrical and Electronics Engineers, Inc, p. 104
Ombabi AH, Lazzez O, Ouarda W, Alimi AM (2017) in 2017 Sudan Conference on Computer Science and Information Technology (SCCSIT), pp. 1–7
Qiu F, Cho J (2006) in Proceedings of the 15th International Conference on World Wide Web (Association for Computing Machinery, New York, NY, USA), WWW ‘06, p. 727–736, https://doi.org/10.1145/1135777.1135883
Ravi L, Vairavasundaram S (2016) A collaborative location based travel recommendation system through enhanced rating prediction for the group of users, Computational intelligence and neuroscience 2016
Sarwat M, Levandoski J, Eldawy A, Mokbel M (2014) LARS*: an efficient and scalable location-aware recommender system. IEEE Trans Knowl Data Eng 26:1–1. https://doi.org/10.1109/TKDE.2013.29
Wang XJ, Yu M, Zhang L, Cai R, Ma WY (2009) in Proceedings of the Third International Workshop on Data Mining and Audience Intelligence for Advertising (Association for Computing Machinery, New York, NY, USA), ADKDD ‘09, 18–26, https://doi.org/10.1145/1592748.1592752
Subramaniyaswamy V, Vijayakumar V, Logesh R, Indragandhi V (2015) Intelligent travel recommendation system by mining attributes from community contributed photos, Procedia Computer Science 50, 447. https://doi.org/10.1016/j.procs.2015.04.014. URL http://www.sciencedirect.com/science/article/pii/S1877050915005153. Big Data, Cloud and Computing Challenges
Simo-Serra E, Fidler S, Moreno-Noguer F, Urtasun R (2015) in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Wang T, Liu H, He J, Du X (2013) in Pacific-Asia Conference on Knowledge Discovery and Data Mining (Springer), 85–98
Wang H, Terrovitis M, Mamoulis N (2013) Location recommendation in location-based social networks using user check-in data. In Proceedings of the 21st ACM SIGSPATIAL international conference on advances in geographic information systems (pp. 374–383)
Wang K, Huang Y, M JO, Van Gool L, Tuytelaars T (2018) in 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 2058–2066
Wen Z, Lin CY (2010) in Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Association for Computing Machinery, New York, NY, USA), KDD ‘10, 373–382, https://doi.org/10.1145/1835804.1835853
White RW, Bailey P, Chen L (2009) in Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (Association for Computing Machinery, New York, NY, USA), SIGIR ‘09, 363–370, https://doi.org/10.1145/1571941.1572005
Xie P, Pei Y, Xie Y, Xing E (2015) in Twenty-Ninth AAAI Conference on Artificial Intelligence
Yang L, Hsieh C, Estrin D (2015) Beyond classification: Latent user interests profiling from visual contents analysis, CoRR abs/1512.06785
Yang S, Huang G, Xiang Y, Zhou X, Chi CH (2017) in 2017 IEEE International Conference on Services Computing (SCC), 204–211
Yassin FM, Lazzez O, Ouarda W, Alimi AM (2017) in 2017 Sudan Conference on Computer Science and Information Technology (SCCSIT), 1–7
Yassine A, Mohamed A, Al Achhabb M (2021) Intelligent recommender system based on unsupervised machine learning and demographic attributes. Simul Model Pract Theory 107:102198
You Q, Bhatia S, Luo J (2015) A picture tells a thousand words - about you! user interest profiling from user generated visual content, CoRR abs/1504.04558
Zhou J, Albatal R, Gurrin C (2016) in International Conference on Multimedia Modeling (Springer), 361–366
Acknowledgments
This research was supported by Research Groups in Intelligent Machines (ReGIM-Lab). We thank Wael Ouarda, a Professor-Researcher in Computer Science at the University of Sfax and quality manager at the ReGIM-Lab at the University of Sfax for comments that greatly improved the manuscript and we thank Adel M. Alimi professor in Electrical and Computer Engineering at the University of Sfax for assistance with application of intelligent methods (neural networks, fuzzy logic) to pattern recognition.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yassin, F.M., Ouarda, W. & Alimi, A.M. Fuzzy ontology as a basis for recommendation Systems for Traveler’s preference. Multimed Tools Appl 81, 6599–6631 (2022). https://doi.org/10.1007/s11042-021-11780-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-11780-5