skip to main content
10.1145/3488560.3498517acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Dy-HIEN: Dynamic Evolution based Deep Hierarchical Intention Network for Membership Prediction

Published: 15 February 2022 Publication History

Abstract

Many video websites offer packages composed of paid videos. Users who purchase a package become members of the website, and thus can enjoy the membership service, such as watching the paid videos. It is practically important to predict which users will become members so that the website can recommend them the suitable packages for purchasing. Existing works generally predict the purchase behavior of users through capturing their interests in items. However, such works cannot be directly applied to the studied problem due to the following challenges. First, some important features of videos and packages change over time, such as the number of clicks and the update of the videos. Existing methods are not capable to capture such dynamic features. Second, a user's purchasing intention is very hard to capture. A user watching a video does not necessarily mean that he/she would like to purchase the corresponding package. In this paper, we propose a Dynamic Evolution based Deep Hierarchical Intention Network (Dy-HIEN for short) for membership prediction, which contains two modules. In the first module, we design a dynamic embedding learning method, applying multi-relational heterogeneous information network and attention mechanism to effectively represent the embedding of videos and packages. In the second module, a hierarchical method is proposed to extract the purchase intention of users. First, the video play history is divided into sessions based on the clicks on packages, and then time-order encoder and kernel functions are applied to mine the intention pattern associated with the package clicked in each session. Extensive experiments on real-world datasets are conducted to demonstrate the advantages of the proposed model on a variety of evaluation metrics.

Supplementary Material

MP4 File (WSDM22-fp793.mp4)
Presentation video

References

[1]
Chong Chen, Weizhi Ma, Min Zhang, Zhaowei Wang, Xiuqiang He, Chenyang Wang, Yiqun Liu, and Shaoping Ma. 2021. Graph Heterogeneous Multi-Relational Recommendation. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 3958--3966.
[2]
Qiwei Chen, Huan Zhao, Wei Li, Pipei Huang, and Wenwu Ou. 2019. Behavior Sequence Transformer for E-commerce Recommendation in Alibaba. CoRR, Vol. abs/1905.06874 (2019). arxiv: 1905.06874
[3]
Kyunghyun Cho, Bart van Merrienboer, cC aglar Gü lcc ehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 1724--1734.
[4]
Palash Goyal, Sujit Rokka Chhetri, and Arquimedes Canedo. 2020. dyngraph2vec: Capturing network dynamics using dynamic graph representation learning. Knowl. Based Syst., Vol. 187 (2020).
[5]
Palash Goyal, Nitin Kamra, Xinran He, and Yan Liu. 2018. DynGEM: Deep Embedding Method for Dynamic Graphs. CoRR, Vol. abs/1805.11273 (2018). arxiv: 1805.11273
[6]
Mihajlo Grbovic and Haibin Cheng. 2018. Real-Time Personalization Using Embeddings for Search Ranking at Airbnb. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & . 311--320.
[7]
Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable Feature Learning for Networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . 855--864.
[8]
Long Guo, Lifeng Hua, Rongfei Jia, Binqiang Zhao, Xiaobo Wang, and Bin Cui. 2019. Buying or Browsing?: Predicting Real-time Purchasing Intent using Attention-based Deep Network with Multiple Behavior. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining . 1984--1992.
[9]
Sepp Hochreiter and Jü rgen Schmidhuber. 1997. Long Short-Term Memory. Neural Comput., Vol. 9, 8 (1997), 1735--1780.
[10]
Chao Huang, Xian Wu, Xuchao Zhang, Chuxu Zhang, Jiashu Zhao, Dawei Yin, and Nitesh V. Chawla. 2019. Online Purchase Prediction via Multi-Scale Modeling of Behavior Dynamics. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2613--2622.
[11]
Wang-Cheng Kang and Julian J. McAuley. 2018. Self-Attentive Sequential Recommendation. In IEEE International Conference on Data Mining . 197--206.
[12]
Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017. 3146--3154.
[13]
Mathias Kraus and Stefan Feuerriegel. 2019. Personalized Purchase Prediction of Market Baskets with Wasserstein-Based Sequence Matching. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining . 2643--2652.
[14]
Chen Li, Xu Zhang, Mahboob Qaosar, Saleh Ahmed, Kazi Md. Rokibul Alam, and Yasuhiko Morimoto. 2019. Multi-factor Based Stock Price Prediction Using Hybrid Neural Networks with Attention Mechanism. In 2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing. 961--966.
[15]
Yuanfu Lu, Chuan Shi, Linmei Hu, and Zhiyuan Liu. 2019. Relation Structure-Aware Heterogeneous Information Network Embedding. In The Thirty-Third AAAI Conference on Artificial Intelligence. 4456--4463.
[16]
Xiao Ma, Liqin Zhao, Guan Huang, Zhi Wang, Zelin Hu, Xiaoqiang Zhu, and Kun Gai. 2018. Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval . 1137--1140.
[17]
Tomá s Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. In 1st International Conference on Learning Representations .
[18]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. In The 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . 701--710.
[19]
Aravind Sankar, Yanhong Wu, Liang Gou, Wei Zhang, and Hao Yang. 2020. DySAT: Deep Neural Representation Learning on Dynamic Graphs via Self-Attention Networks. In WSDM '20: The Thirteenth ACM International Conference on Web Search and Data Mining. 519--527.
[20]
Chuan Shi, Binbin Hu, Wayne Xin Zhao, and Philip S. Yu. 2019. Heterogeneous Information Network Embedding for Recommendation. IEEE Trans. Knowl. Data Eng., Vol. 31 (2019), 357--370. https://doi.org/10.1109/TKDE.2018.2833443
[21]
Yumin Su, Liang Zhang, Quanyu Dai, Bo Zhang, Jinyao Yan, Dan Wang, Yongjun Bao, Sulong Xu, Yang He, and Weipeng Yan. 2020. An Attention-based Model for Conversion Rate Prediction with Delayed Feedback via Post-click Calibration. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. 3522--3528.
[22]
Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. LINE: Large-scale Information Network Embedding. In Proceedings of the 24th International Conference on World Wide Web. 1067--1077.
[23]
Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural Deep Network Embedding. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . 1225--1234.
[24]
Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Yanfang Ye, Peng Cui, and Philip S Yu. 2019. Heterogeneous Graph Attention Network. In The World Wide Web Conference . 2022--2032.
[25]
Hong Wen, Jing Zhang, Yuan Wang, Wentian Bao, Quan Lin, and Keping Yang. 2019. Conversion Rate Prediction via Post-Click Behaviour Modeling. CoRR, Vol. abs/1910.07099 (2019). arxiv: 1910.07099
[26]
Jibang Wu, Renqin Cai, and Hongning Wang. 2020. Dé jà vu: A Contextualized Temporal Attention Mechanism for Sequential Recommendation. In WWW '20: The Web Conference 2020 . 2199--2209.
[27]
Jianjun Wu, Ying Sha, Bo Jiang, and Jianlong Tan. 2019. DSINE: Deep Structural Influence Learning via Network Embedding. In The Thirty-Third AAAI Conference on Artificial Intelligence. 10065--10066.
[28]
Luwei Yang, Zhibo Xiao, Wen Jiang, Yi Wei, Yi Hu, and Hao Wang. 2020. Dynamic Heterogeneous Graph Embedding Using Hierarchical Attentions. In Advances in Information Retrieval - 42nd European Conference on IR Research (Lecture Notes in Computer Science), Vol. 12036. 425--432.
[29]
Yuya Yoshikawa and Yusaku Imai. 2018. A Nonparametric Delayed Feedback Model for Conversion Rate Prediction. CoRR, Vol. abs/1802.00255 (2018).
[30]
Chuxu Zhang, Dongjin Song, Chao Huang, Ananthram Swami, and Nitesh V. Chawla. 2019. Heterogeneous Graph Neural Network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining . 793--803.
[31]
Guorui Zhou, Na Mou, Ying Fan, Qi Pi, Weijie Bian, Chang Zhou, Xiaoqiang Zhu, and Kun Gai. 2019. Deep Interest Evolution Network for Click-Through Rate Prediction. In The Thirty-Third AAAI Conference on Artificial Intelligence. 5941--5948.
[32]
Guorui Zhou, Xiaoqiang Zhu, Chengru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, and Kun Gai. 2018. Deep Interest Network for Click-Through Rate Prediction. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining . 1059--1068.
[33]
Zhihua Zhu, Xinxin Fan, Xiaokai Chu, Jianhui Huang, and Jingping Bi. 2020. LRHNE: A Latent-Relation Enhanced Embedding Method for Heterogeneous Information Networks. In CIKM '20: The 29th ACM International Conference on Information and Knowledge Management. 1923--1932.

Cited By

View all

Index Terms

  1. Dy-HIEN: Dynamic Evolution based Deep Hierarchical Intention Network for Membership Prediction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WSDM '22: Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining
    February 2022
    1690 pages
    ISBN:9781450391320
    DOI:10.1145/3488560
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 February 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. dynamic embedding learning
    2. hierarchical intention evolution
    3. membership prediction

    Qualifiers

    • Research-article

    Conference

    WSDM '22

    Acceptance Rates

    Overall Acceptance Rate 498 of 2,863 submissions, 17%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media