Abstract
Various user behaviors are providing valuable information for user interest modeling in online information platforms. For the phenomenon that some kinds of behavior data are insufficient to express users’ preferences, therefore, some cross-domain or multi-behavior fusion approaches are proposed to solve it. However, we have not yet understood which behaviors can be transferred and which behaviors can be better transferred to the target behavior. In this paper, we propose a novel knowledge transferability metric, TEMCS (Transfer Entropy with Multi-Concept Semantic), to measure the transferability of knowledge from the source to the target behavior sequence. The new metric not only can obtain the maximum semantics of the sequence based on the multi-concept semantic compression mechanism, but also can further achieve the dynamic information transfer between two sequences by modeling the inter-sequence coupling association founded on the transfer entropy. In particular, TEMCS is model-agnostic, calculation-simple, and requires no training on the source and target behavior sequences. Furthermore, TEMCS can be used as the weight of the difference between the source domain and target domain behavior characteristics, thereby reducing the distribution of the source domain and target domain characteristics and improving the performance of target behavior prediction. Extensive experiments on two real datasets demonstrate that our transferability metric is reasonable and effective, which not only can guide the choice of appropriate source behaviors but also can improve the performance of transfer models and multi-behavior models.






Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
Our code and data are available at https://github.com/linuo1/TEMCS.
References
Azizpour H, Razavian AS, Sullivan J, Maki A, Carlsson S (2015) Factors of transferability for a generic convnet representation. IEEE Trans Pattern Anal Mach Intell 38(9):1790–1802
Bao Y, Li Y, Huang S-L, Zhang L, Zheng L, Zamir A, Guibas L (2019) An information-theoretic approach to transferability in task transfer learning. In: 2019 IEEE International Conference on Image Processing (ICIP), pp 2309–2313. IEEE
Chen C, Zhang M, Zhang Y, Ma W, Liu Y, Ma S (2020) Efficient heterogeneous collaborative filtering without negative sampling for recommendation. Proc AAAI Conf Artif Intell 34:19–26
Chen C, Ma W, Zhang M, Wang Z, He X, Wang C, Liu Y, Ma S (2021) Graph heterogeneous multi-relational recommendation. Proceedings of the AAAI Conference on Artificial Intelligence 35:3958–3966
Chen T, Yin H, Nguyen QVH, Peng W-C, Li X, Zhou X (2020) Sequence-aware factorization machines for temporal predictive analytics. In: 2020 IEEE 36th International Conference on Data Engineering (ICDE), pp 1405–1416. IEEE
Covington P, Adams J, Sargin E (2016) Deep neural networks for youtube recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems, pp 191–198
Dong M, Yuan F, Yao L, Xu X, Zhu L Mamo (2020) Memory-augmented meta-optimization for cold-start recommendation. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 688–697
Feng X, Chen C, Li D, Zhao M, Hao J, Wang J (2021) Cmml: Contextual modulation meta learning for cold-start recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp 484–493
Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp 1180–1189. PMLR
Gao C, He X, Gan D, Chen X, Feng F, Li Y, Chua T-S, Yao L, Song Y, Jin D (2019) Learning to recommend with multiple cascading behaviors. IEEE Trans Knowl Data Eng 33(6):2588–2601
Gao C, He X, Gan D, Chen X, Feng F, Li Y, Chua T-S, Jin D (2019) Neural multi-task recommendation from multi-behavior data. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp 1554–1557. IEEE
Ghifary M, Kleijn WB, Zhang M (2014) Domain adaptive neural networks for object recognition. In: Pacific Rim International Conference on Artificial Intelligence, pp 898–904. Springer
He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S (2017) Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web, pp 173–182
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939
Jang Y, Lee H, Hwang SJ, Shin J (2019) Learning what and where to transfer. In: International Conference on Machine Learning, pp. 3030–3039. PMLR
Jin B, Gao C, He X, Jin D, Li Y (2020) Multi-behavior recommendation with graph convolutional networks. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 659–668
Jin B, Gao C, He X, Jin D, Li Y (2020) Multi-behavior recommendation with graph convolutional networks. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 659–668
Ji Z, Wang B (2013) Learning to rank for question routing in community question answering. In: Proceedings of the 22nd ACM International Conference on Information & Knowledge Management, pp 2363–2368
Kanagawa H, Kobayashi H, Shimizu N, Tagami Y, Suzuki T (2019) Cross-domain recommendation via deep domain adaptation. In: European Conference on Information Retrieval, pp. 20–29. Springer
Long M, Cao Y, Wang J, Jordan M (2015) Learning transferable features with deep adaptation networks. In: International Conference on Machine Learning, pp 97–105. PMLR
Long M, Zhu H, Wang J, Jordan MI (2017) Deep transfer learning with joint adaptation networks. In: International Conference on Machine Learning, pp 2208–2217. PMLR
Lu C (2019) Semantic information g theory and logical bayesian inference for machine learning. Information 10(8):261
MacQueen J et al (1967) Some methods for classification and analysis of multivariate observations. Proc Fifth Berkeley Symposium Math Stat Probab 1:281–297 (Oakland, CA, USA)
Mignone P, Pio G, Džeroski S, Ceci M (2020) Multi-task learning for the simultaneous reconstruction of the human and mouse gene regulatory networks. Sci Rep 10(1):1–15
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
Moon S, Carbonell JG (2017) Completely heterogeneous transfer learning with attention-what and what not to transfer. IJCAI 1:1–2
Nguyen C, Hassner T, Seeger M, Archambeau C (2020) Leep: A new measure to evaluate transferability of learned representations. In: International Conference on Machine Learning, pp 7294–7305. PMLR
Ni Y, Ou D, Liu S, Li X, Ou W, Zeng A, Si, L (2018) Perceive your users in depth: Learning universal user representations from multiple e-commerce tasks. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 596–605
Ouyang W, Zhang X, Li L, Zou H, Xing X, Liu Z, Du Y (2019) Deep spatio-temporal neural networks for click-through rate prediction. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 2078–2086
Ouyang W, Zhang X, Zhao L, Luo J, Zhang Y, Zou H, Liu Z, Du Y (2020) Minet: Mixed interest network for cross-domain click-through rate prediction. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp 2669–2676
Pio G, Mignone P, Magazzù G, Zampieri G, Ceci M, Angione C (2022) Integrating genome-scale metabolic modelling and transfer learning for human gene regulatory network reconstruction. Bioinformatics 38(2):487–493
Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the Eleventh ACM Conference on Recommender Systems, pp 130–137
Schreiber T (2000) Measuring information transfer. Phys Rev Lett 85(2):461
Singh AP, Gordon GJ (2008) Relational learning via collective matrix factorization. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 650–658
Sun B, Saenko K (2016) Deep coral: Correlation alignment for deep domain adaptation. In: European Conference on Computer Vision, pp 443–450. Springer
Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp 565–573
Tan Y, Li Y, Huang S-L (2021) Otce: A transferability metric for cross-domain cross-task representations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 15779–15788
Tran AT, Nguyen CV, Hassner T (2019) Transferability and hardness of supervised classification tasks. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 1395–1405
Wang X, Li L, Ye W, Long M, Wang J (2019) Transferable attention for domain adaptation. Proc AAAI Conf Artif Intell 33:5345–5352
Wang T, Zhuang F, Zhang Z, Wang D, Zhou J, He Q (2021) Low-dimensional alignment for cross-domain recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp 3508–3512
Xu F, Ji Z, Wang B (2012) Dual role model for question recommendation in community question answering. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 771–780
Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? arXiv preprint arXiv:1411.1792
Yuan F, Karatzoglou A, Arapakis I, Jose JM, He X (2019) A simple convolutional generative network for next item recommendation. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp 582–590
Yuan F, Yao L, Benatallah B (2019) Darec: Deep domain adaptation for cross-domain recommendation via transferring rating patterns. arXiv preprint arXiv:1905.10760
Zamir AR, Sax A, Shen W, Guibas LJ, Malik J, Savarese S (2018) Taskonomy: Disentangling task transfer learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3712–3722
Zhang J, Ding Z, Li W, Ogunbona P (2018) Importance weighted adversarial nets for partial domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 8156–8164
Zhang H, Kong X, Zhang Y (2022) Cross-domain collaborative recommendation without overlapping entities based on domain adaptation. Multimedia Systems, 1–17
Zhao Z, Cheng Z, Hong L, Chi EH (2015) Improving user topic interest profiles by behavior factorization. In: Proceedings of the 24th International Conference on World Wide Web, pp 1406–1416
Zhao C, Li C, Xiao R, Deng H, Sun A (2020) Catn: Cross-domain recommendation for cold-start users via aspect transfer network. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp 229–238
Zhou C, Bai J, Song J, Liu X, Zhao Z, Chen X, Gao J (2018) Atrank: An attention-based user behavior modeling framework for recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32
Zhou G, Zhu X, Song C, Fan Y, Zhu H, Ma X, Yan Y, Jin J, Li H, Gai K (2018) Deep interest network for click-through rate prediction. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp 1059–1068
Zhu Y, Chen Y, Lu Z, Pan SJ, Xue G-R, Yu Y, Yang Q (2011) Heterogeneous transfer learning for image classification. In: Twenty-fifth Aaai Conference on Artificial Intelligence
Zhu Y, Tang Z, Liu Y, Zhuang F, Xie R, Zhang X, Lin L, He Q (2022) Personalized transfer of user preferences for cross-domain recommendation. In: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, pp 1507–1515
Acknowledgements
This work was partially supported by the National Science Fund for Distinguished Young Scholars(62025205, 61725205), National Key R &D Program of China(2019YFB1703901), and the National Natural Science Foundation of China (No.62032020, 61960206008, 62102317).
Author information
Authors and Affiliations
Corresponding author
Additional information
Responsible editor: Peggy Cellier and Albrecht Zimmermann.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, N., Guo, B., Liu, Y. et al. Transfer how much: a fine-grained measure of the knowledge transferability of user behavior sequences in social network. Data Min Knowl Disc 36, 2214–2236 (2022). https://doi.org/10.1007/s10618-022-00857-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10618-022-00857-w