Skip to main content
SpringerLink
Log in

Weighted multi-information constrained matrix factorization for personalized travel location recommendation based on geo-tagged photos

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Given travel history, travel location recommendation can automatically suggest users where to visit. Huge efforts have been devoted to introducing different additional information (e.g., sequential, textual, geographical, and visual information) for enhancing recommendation performance. However, existing methods only consider limited additional information and treat different information equally. In this paper, we present Weighted Multi-Information Constrained Matrix Factorization (WIND-MF) for personalized travel location recommendation based on geo-tagged photos. On one hand, photos (visual information), users’ visit sequences (sequential information), and textual tags (textual information) are leveraged to comprehensively profile users and travel locations. On the other hand, visual, sequential, and textual similarities as well as geographical distance based co-visit probabilities are assigned with different weights to constrain the factorization of the original user-travel location matrix. We experimented on a dataset of six cities in China, and the experiment results verify the superiority of the proposed method. The code and dataset is available at https://github.com/revaludo/WIND-MF.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Zheng YT, Zha ZJ, Chua TS (2011) Research and applications on georeferenced multimedia: a survey. Multimed Tools Appl 51(1):77–98

    Article  Google Scholar 

  2. Zheng Y, Zhang L, Xie X, Ma WY (2009) Mining interesting locations and travel sequences from GPS trajectories. Proceedings of the International Conference on World Wide Web: 791–800

  3. Zheng Y, Zhang L, Ma Z, Xie X, Ma WY (2011) Recommending friends and locations based on individual location history. ACM Trans Web 5(1):5

    Article  Google Scholar 

  4. Zheng Y, Xie X (2011) Learning travel recommendations from user-generated GPS traces. ACM Trans Intell Syst Technol 2(1):2

    Article  Google Scholar 

  5. Ye M, Yin P, Lee WC, Lee DL (2011) Exploiting geographical influence for collaborative point-of-interest recommendation. Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval: 325–334

  6. Hsieh HP, Li CT, Lin SD (2012) Exploiting large-scale check-in data to recommend time-sensitive routes. Proceedings of the ACM SIGKDD International Workshop on Urban Computing: 55–62

  7. Gao H, Tang J, Hu X, Liu H (2015) Content-aware point of interest recommendation on location-based social networks. Proceedings of the AAAI conference on artificial intelligence: 1721–1727

  8. Ying Y, Chen L, Chen G (2017) A temporal-aware POI recommendation system using context-aware tensor decomposition and weighted HITS. Neurocomputing 242:195–205

    Article  Google Scholar 

  9. Clements M, Serdyukov P, De Vries AP, Reinders MJ (2010) Using flickr geotags to predict user travel behaviour. In: Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval: 851–852

  10. Mamei M, Rosi A, Zambonelli F (2010) Automatic analysis of geotagged photos for intelligent tourist services. Proceedings of the International Conference on Intelligent Environments: 146–151

  11. Popescu A, Grefenstette G (2011) Mining social media to create personalized recommendations for tourist visits. Proceedings of the international conference on computing for Geospatial Research & Applications: 37

  12. Yang C, Sun M, Zhao WX, Liu Z, Chang EY (2017) A neural network approach to jointly modeling social networks and mobile trajectories. ACM Trans Inf Syst 35(4):36

    Article  Google Scholar 

  13. Liu X, Liu Y, Li X (2016) Exploring the context of locations for personalized location recommendations. Proceedings of the international joint conference on artificial intelligence: 1188–1194

  14. Kurashima T, Iwata T, Irie G, Fujimura K (2013) Travel route recommendation using geotagged photos. Knowl Inf Syst 37(1):37–60

    Article  Google Scholar 

  15. Majid A, Chen L, Mirza HT, Hussain I, Chen G (2015) A system for mining interesting tourist locations and travel sequences from public geo-tagged photos. Data Knowl Eng 95:66–86

    Article  Google Scholar 

  16. Majid A, Chen L, Chen G, Mirza HT, Hussain I, Woodward J (2013) A context-aware personalized travel recommendation system based on geotagged social media data mining. Int J Geogr Inf Sci 27(4):662–684

    Article  Google Scholar 

  17. Jiang S, Qian X, Shen J, Fu Y, Mei T (2015) Author topic model-based collaborative filtering for personalized POI recommendations. IEEE Trans Multimed 17(6):907–918

    Google Scholar 

  18. Yuan Q, Cong G, Ma Z, Sun A, Thalmann NM (2013) Time-aware point-of-interest recommendation. Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval: 363–372

  19. Cheng C, Yang H, King I, Lyu MR (2012) Fused matrix factorization with geographical and social influence in location-based social networks. Proceedings of the AAAI conference on artificial intelligence: 17–23

  20. Zhao P, Xu X, Liu Y, Sheng VS, Zheng K, Xiong H (2017) Photo2trip: exploiting visual contents in geo-tagged photos for personalized tour recommendation. Proceedings of the ACM International Conference on Multimedia: 916–924

  21. Wang S, Wang Y, Tang J, Shu K, Ranganath S, Liu H (2017) What your images reveal: exploiting visual contents for point-of-interest recommendation. Proceedings of the International Conference on World Wide Web: 391–400

  22. Cheng AJ, Chen YY, Huang YT, Hsu WH, Liao HYM (2011) Personalized travel recommendation by mining people attributes from community-contributed photos. Proceedings of the ACM International Conference on Multimedia: 83–92

  23. Chen YY, Cheng AJ, Hsu WH (2013) Travel recommendation by mining people attributes and travel group types from community-contributed photos. IEEE Trans Multimed 15(6):1283–1295

    Article  Google Scholar 

  24. Yang C, Bai L, Zhang C, Yuan Q, Han J (2017) Bridging collaborative filtering and semi-supervised learning: a neural approach for POI recommendation. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1245–1254

  25. Zhou N, Zhao WX, Zhang X, Wen JR, Wang S (2016) A general multi-context embedding model for mining human trajectory data. IEEE Trans Knowl Data Eng 28(8):1945–1958

    Article  Google Scholar 

  26. Cai L, Xu J, Liu J, Pei T (2018) Integrating spatial and temporal contexts into a factorization model for POI recommendation. Int J Geogr Inf Sci 32(3):524–546

    Article  Google Scholar 

  27. Xu Z, Chen L, Dai Y, Chen G (2017) A dynamic topic model and matrix factorization-based travel recommendation method exploiting ubiquitous data. IEEE Trans Multimed 19(8):1933–1945

    Article  Google Scholar 

  28. Zheng VW, Zheng Y, Xie X, Yang Q (2010) Collaborative location and activity recommendations with GPS history data. Proceedings of the International Conference on World Wide Web: 1029–1038

  29. Bao J, Zheng Y, Wilkie D, Mokbel M (2015) Recommendations in location-based social networks: a survey. GeoInformatica 19(3):525–565

    Article  Google Scholar 

  30. Gao H, Tang J, Liu H (2012) Exploring social-historical ties on location-based social networks. Proceedings of the international AAAI conference on weblogs and social media: 114–121

  31. Long X, Joshi J (2013) A HITS-based POI recommendation algorithm for location-based social networks. Proceedings of the International Conference on Advances in Social Networks Analysis and Mining: 642–647

  32. Cheng C, Yang H, Lyu MR, King I (2013) Where you like to go next: successive point-of-interest recommendation. Proceedings of the international joint conference on artificial intelligence: 2605–2611

  33. Le Q, Mikolov T (2014) Distributed representations of sentences and documents. Proceedings of the international conference on machine learning: 1188–1196

  34. Ye M, Shou D, Lee WC, Yin P, Janowicz K (2011) On the semantic annotation of places in location-based social networks. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining: 520–528

  35. Memon I, Chen L, Majid A, Lv M, Hussain I, Chen G (2015) Travel recommendation using geo-tagged photos in social media for tourist. Wirel Pers Commun 80(4):1347–1362

    Article  Google Scholar 

  36. Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3(Jan):993–1022

    MATH  Google Scholar 

  37. Zhang F, Yuan NJ, Lian D, Xie X, Ma WY (2016) Collaborative knowledge base embedding for recommender systems. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining: 353–362

  38. Kingma DP, Welling M (2013) Auto-encoding variational bayes. arXiv preprint arXiv: 13126114

  39. Ding R, Chen Z (2018) Recnet: a deep neural network for personalized POI recommendation in location-based social networks. Int J Geogr Inf Sci 32(8):1631–1648

    Article  Google Scholar 

  40. Kurashima T, Iwata T, Irie G, Fujimura K (2010) Travel route recommendation using geotags in photo sharing sites. Proceedings of the ACM International Conference on Information and Knowledge Management: 579–588

  41. Zheng YT, Zha ZJ, Chua TS (2012) Mining travel patterns from geotagged photos. ACM Trans Intell Syst Technol 3(3):56

    Article  Google Scholar 

  42. Kisilevich S, Mansmann F, Keim D (2010) P-DBSCAN: a density based clustering algorithm for exploration and analysis of attractive areas using collections of geo-tagged photos. Proceedings of the international conference and exhibition on computing for Geospatial Research & Application: 38

  43. Xu Z, Chen L, Chen G (2015) Topic based context-aware travel recommendation method exploiting geotagged photos. Neurocomputing 155:99–107

    Article  Google Scholar 

  44. Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. Proceedings of the neural information processing systems conference: 3111–3119

  45. Papadimitriou CH, Raghavan P, Tamaki H, Vempala S (2000) Latent semantic indexing: a probabilistic analysis. J Comput Syst Sci 61(2):217–235

    Article  MathSciNet  Google Scholar 

  46. Grbovic M, Radosavljevic V, Djuric N, Bhamidipati N, Savla J, Bhagwan V, Sharp D (2015) E-commerce in your inbox: product recommendations at scale. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining: 1809–1818

  47. Isinkaye F, Folajimi Y, Ojokoh B (2015) Recommendation systems: principles, methods and evaluation. Egyptian Inform J 16(3):261–273

    Article  Google Scholar 

  48. Bokde D, Girase S, Mukhopadhyay D (2015) Matrix factorization model in collaborative filtering algorithms: a survey. Proc Comput Sci 49:136–146

    Article  Google Scholar 

  49. Yu Y, Wang C, Wang H, Gao Y (2017) Attributes coupling based matrix factorization for item recommendation. Appl Intell 46(3):521–533

    Article  Google Scholar 

  50. Xing S, Liu F, Zhao X, Li T (2018) Points-of-interest recommendation based on convolution matrix factorization. Appl Intell 48(8):2458–2469

    Article  Google Scholar 

  51. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer (8):30–37

    Article  Google Scholar 

  52. Hu Y, Koren Y, Volinsky C (2008) Collaborative filtering for implicit feedback datasets. Proceedings of the IEEE International Conference on Data Mining: 263–272

Download references

Acknowledgements

This work is supported by the National Key Research and Development Program of China under Grant No. 2018YFB0505000.

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Zhejiang University, Hangzhou, 310027, China

    Dandan Lyu, Ling Chen, Zhenxing Xu & Shanshan Yu

Authors
  1. Dandan Lyu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ling Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhenxing Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shanshan Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ling Chen.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lyu, D., Chen, L., Xu, Z. et al. Weighted multi-information constrained matrix factorization for personalized travel location recommendation based on geo-tagged photos. Appl Intell 50, 924–938 (2020). https://doi.org/10.1007/s10489-019-01566-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-019-01566-6

Keywords

Search

Navigation