research-article

Learning to Build User-tag Profile in Recommendation System

Authors:

Leyu LinAuthors Info & Claims

CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management

Pages 2877 - 2884

https://doi.org/10.1145/3340531.3412719

Published: 19 October 2020 Publication History

Abstract

User profiling is one of the most important components in recommendation systems, where a user is profiled using demographic (e.g. gender, age, and location) and user behavior information (e.g. browsing and search history). Among different dimensions of user profiling, tagging is an explainable and widely-used representation of user interest. In this paper, we propose a user tag profiling model (UTPM) to study user-tag profiling as a multi-label classification task using deep neural networks. Different from the conventional model, our UTPM model is a multi-head attention mechanism with shared query vectors to learn sparse features across different fields. Besides, we introduce the improved FM-based cross feature layer, which outperforms many state-of-the-art cross feature methods and further enhances model performance. Meanwhile, we design a novel joint method to learn the preference of different tags from a single clicked news article in recommendation systems. Furthermore, our UTPM model is deployed in the WeChat "Top Stories" recommender system, where both online and offline experiments demonstrate the superiority of the proposed model over baseline models.

Supplementary Material

MP4 File (3340531.3412719.mp4)

Presentation Video.

Download
10.50 MB

References

[1]

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014).

[2]

Fabiano M Belém, Jussara M Almeida, and Marcos A Goncc alves. 2017. A survey on tag recommendation methods. Journal of the Association for Information Science and Technology, Vol. 68, 4 (2017), 830--844.

Digital Library

[3]

Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 335--344.

Digital Library

[4]

Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 191--198.

Digital Library

[5]

Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. Deepfm: a factorization-machine based neural network for ctr prediction. arXiv preprint arXiv:1703.04247 (2017).

[6]

F Maxwell Harper and Joseph A Konstan. 2016. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis), Vol. 5, 4 (2016), 19.

[7]

Xiangnan He and Tat-Seng Chua. 2017. Neural factorization machines for sparse predictive analytics. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 355--364.

Digital Library

[8]

Robert J"aschke, Leandro Marinho, Andreas Hotho, Lars Schmidt-Thieme, and Gerd Stumme. 2007. Tag recommendations in folksonomies. In European Conference on Principles of Data Mining and Knowledge Discovery. Springer, 506--514.

[9]

Jianxun Lian, Xiaohuan Zhou, Fuzheng Zhang, Zhongxia Chen, Xing Xie, and Guangzhong Sun. 2018. xdeepfm: Combining explicit and implicit feature interactions for recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1754--1763.

Digital Library

[10]

Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017. A structured self-attentive sentence embedding. arXiv preprint arXiv:1703.03130 (2017).

[11]

Yudan Liu, Kaikai Ge, Xu Zhang, and Leyu Lin. 2019. Real-time Attention Based Look-alike Model for Recommender System. arXiv preprint arXiv:1906.05022 (2019).

[12]

Wanvimol Nadee. 2016. Modelling user profiles for recommender systems. Ph.D. Dissertation. Queensland University of Technology.

[13]

Steffen Rendle. 2010. Factorization machines. In 2010 IEEE International Conference on Data Mining. IEEE, 995--1000.

Digital Library

[14]

Weiping Song, Chence Shi, Zhiping Xiao, Zhijian Duan, Yewen Xu, Ming Zhang, and Jian Tang. 2019. Autoint: Automatic feature interaction learning via self-attentive neural networks. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1161--1170.

Digital Library

[15]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998--6008.

[16]

Jesse Vig, Shilad Sen, and John Riedl. 2009. Tagsplanations: explaining recommendations using tags. In Proceedings of the 14th international conference on Intelligent user interfaces. ACM, 47--56.

Digital Library

[17]

Ruoxi Wang, Bin Fu, Gang Fu, and Mingliang Wang. 2017. Deep & cross network for ad click predictions. In Proceedings of the ADKDD'17. ACM, 12.

Digital Library

[18]

Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang, Fei Wu, and Tat-Seng Chua. 2017. Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv preprint arXiv:1708.04617 (2017).

[19]

Deqing Yang, Yanghua Xiao, Hanghang Tong, Junjun Zhang, and Wei Wang. 2015. An integrated tag recommendation algorithm towards weibo user profiling. In International Conference on Database Systems for Advanced Applications. Springer, 353--373.

[20]

Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierarchical attention networks for document classification. In Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies. 1480--1489.

[21]

Chang Zhou, Jinze Bai, Junshuai Song, Xiaofei Liu, Zhengchao Zhao, Xiusi Chen, and Jun Gao. 2018a. ATRank: An attention-based user behavior modeling framework for recommendation. In Thirty-Second AAAI Conference on Artificial Intelligence.

[22]

Guorui Zhou, Na Mou, Ying Fan, Qi Pi, Weijie Bian, Chang Zhou, Xiaoqiang Zhu, and Kun Gai. 2019. Deep interest evolution network for click-through rate prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 5941--5948.

Digital Library

[23]

Guorui Zhou, Xiaoqiang Zhu, Chenru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, and Kun Gai. 2018b. Deep interest network for click-through rate prediction. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1059--1068.

Digital Library

Cited By

Choi SLee DKang HCho H(2025)Exploring the Side-Information Fusion for Sequential RecommendationIEEE Access10.1109/ACCESS.2025.352581213(8839-8850)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3525812
He WXiao YLi TWang RLi Q(2024)Interest HD: An Interest Frame Model for Recommendation Based on HD Image GenerationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.327867335:10(14356-14369)Online publication date: Oct-2024
https://doi.org/10.1109/TNNLS.2023.3278673
Duan TZhao JZhang STao JWang P(2024)Representation Learning of Tangled Key-Value Sequence Data for Early Classification2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00086(1063-1075)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00086
Show More Cited By

Index Terms

Learning to Build User-tag Profile in Recommendation System
1. Information systems
  1. World Wide Web
    1. Web searching and information discovery
      1. Personalization

Recommendations

Personalized news recommendation: a review and an experimental investigation
Special issue on Community Analysis and Information Recommendation

Online news articles, as a new format of press releases, have sprung up on the Internet. With its convenience and recency, more and more people prefer to read news online instead of reading the paper-format press releases. However, a gigantic amount of ...
Personalized Content Recommendation and User Satisfaction: Theoretical Synthesis and Empirical Findings

Personalized services are increasingly popular in the Internet world. This study identifies theories related to the use of personalized content services and their effect on user satisfaction. Three major theories have been identified-information ...
Integrating collaborative filtering and matching-based search for product recommendations

Currently, recommender systems (RS) have been widely applied in many commercial e-commerce sites to help users deal with the information overload problem. Recommender systems provide personalized recommendations to users and, thus, help in making good ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management

October 2020

3619 pages

ISBN:9781450368599

DOI:10.1145/3340531

General Chairs:
Mathieu d'Aquin
DSI, Insight, NUI Galway, Ireland
,
Stefan Dietze
GESIS, Cologne, Germany, Heinrich-Heine-University Düsseldorf, Germany, L3S Research Center, Germany
,
Program Chairs:
Claudia Hauff
TU Delft, The Netherlands
,
Edward Curry
DSI, Insight, NUI Galway, Ireland
,
Philippe Cudre Mauroux
eXascale, University of Fribourg, Switzerland

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIKM '20

Sponsor:

CIKM '20: The 29th ACM International Conference on Information and Knowledge Management

October 19 - 23, 2020

Virtual Event, Ireland

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
1,539
Total Downloads

Downloads (Last 12 months)105
Downloads (Last 6 weeks)4

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Choi SLee DKang HCho H(2025)Exploring the Side-Information Fusion for Sequential RecommendationIEEE Access10.1109/ACCESS.2025.352581213(8839-8850)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3525812
He WXiao YLi TWang RLi Q(2024)Interest HD: An Interest Frame Model for Recommendation Based on HD Image GenerationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.327867335:10(14356-14369)Online publication date: Oct-2024
https://doi.org/10.1109/TNNLS.2023.3278673
Duan TZhao JZhang STao JWang P(2024)Representation Learning of Tangled Key-Value Sequence Data for Early Classification2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00086(1063-1075)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00086
Chaparala PNagabhushan PPonduri LKummari P(2024)Mapping Item-wise Rating into Attribute-wise Ratings for Enhanced Personalized Recommendations2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT)10.1109/ICCCNT61001.2024.10724325(1-6)Online publication date: 24-Jun-2024
https://doi.org/10.1109/ICCCNT61001.2024.10724325
Zhu XDu PShao SZhu CZhang WWang YCao YSingh ASun YAkoglu LGunopulos DYan XKumar ROzcan FYe J(2023)A Feature-Based Coalition Game Framework with Privileged Knowledge Transfer for User-tag Profile ModelingProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599761(5739-5749)Online publication date: 6-Aug-2023
https://dl.acm.org/doi/10.1145/3580305.3599761
Qu XLiu HSun ZYin XOng YLu LMa ZChen HDuh WHuang HKato MMothe JPoblete B(2023)Towards Building Voice-based Conversational Recommender Systems: Datasets, Potential Solutions and ProspectsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591876(2701-2711)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3591876
Wen XZhao SWang HWu RQu MHu TChen GTao JFan C(2023)Multi-Source Multi-Label Learning for User Profiling in Online GamesIEEE Transactions on Multimedia10.1109/TMM.2022.317168325(4135-4147)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3171683
de Campos LFernández-Luna JHuete J(2023)Use of topical and temporal profiles and their hybridisation for content-based recommendationUser Modeling and User-Adapted Interaction10.1007/s11257-022-09354-733:4(911-937)Online publication date: 23-Jan-2023
https://doi.org/10.1007/s11257-022-09354-7
Zhu CDu PZhu XZhang WYu YCao YZhang ARangwala H(2022)User-tag Profile Modeling in Recommendation System via Contrast Weighted Tag MaskingProceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3534678.3539102(4630-4638)Online publication date: 14-Aug-2022
https://dl.acm.org/doi/10.1145/3534678.3539102
Xu ZZhao MLiu LXiao LZhang XZhang BZhang ARangwala H(2022)Mixture of Virtual-Kernel Experts for Multi-Objective User Profile ModelingProceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3534678.3539062(4257-4267)Online publication date: 14-Aug-2022
https://dl.acm.org/doi/10.1145/3534678.3539062
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten