skip to main content
10.1145/3511047.3537667acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
research-article

Hierarchical Transformers for Group-Aware Sequential Recommendation: Application in MOBA Games

Published: 04 July 2022 Publication History

Abstract

In recent years, several recommendation systems have been introduced to improve the user experience of players in video games. In Multiplayer Online Battle Arena (MOBA) games, a popular game genre, these systems are useful for recommending items for a character during a match. Current approaches focus on recommending a fixed set of items based on a character and the other participants. However, a MOBA match is an inherently sequential process, where its past decisions define the current ones. Therefore, it would be desirable to obtain a contextual recommendation considering a specific situation and the previously consumed items. To fill this gap, in this work, we propose HT4Rec for group-aware sequential item recommendation. It consists of a contextual encoder that generates a character-item representation contextualized by the other participants involved in the game, followed by a sequential encoder that captures sequential patterns of the data to recommend the next item. In this way, HT4Rec provides a flexible and unified attention-based network structure to capture both general and long-term preferences. Our evaluations on a Dota 2 video game dataset demonstrate that HT4Rec outperforms well-known sequential recommendation methods on various evaluation metrics. Additional experiments unveil the most important parts of our model and the most relevant inputs according to the attention mechanism, which could be used to interpret the suggested items. Furthermore, we demonstrate that HT4Rec could be applied to a different scenario (movie recommendation) than MOBA games, showing better results than the baseline models.

References

[1]
Vladimir Araujo, Felipe Rios, and Denis Parra. 2019. Data Mining for Item Recommendation in MOBA Games. In Proc. of the 13th ACM Conference on Recommender Systems (Copenhagen, Denmark) (RecSys ’19). ACM, New York, NY, USA, 393–397. https://doi.org/10.1145/3298689.3346986
[2]
Paul Bertens, Anna Guitart, Pei Pei Chen, and Africa Perianez. 2018. A machine-learning item recommendation system for video games. In 2018 IEEE Conference on Computational Intelligence and Games (CIG). IEEE, 1–4.
[3]
O. Cavadenti, V. Codocedo, J. Boulicaut, and M. Kaytoue. 2016. What Did I Do Wrong in My MOBA Game? Mining Patterns Discriminating Deviant Behaviours. In 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA). 662–671. https://doi.org/10.1109/DSAA.2016.75
[4]
Zhengxing Chen, Truong-Huy D Nguyen, Yuyu Xu, Christopher Amato, Seth Cooper, Yizhou Sun, and Magy Seif El-Nasr. 2018. The art of drafting: A Team-Oriented Hero Recommendation System for Multiplayer Online Battle Arena Games. In Proc. of the 12th ACM Conference on Recommender Systems - RecSys '18. ACM Press. https://doi.org/10.1145/3240323.3240345
[5]
Germán Cheuque, José Guzmán, and Denis Parra. 2019. Recommender systems for Online video game platforms: The case of STEAM. In Companion Proc. of The 2019 World Wide Web Conference. 763–771.
[6]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proc. of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186. https://doi.org/10.18653/v1/N19-1423
[7]
D. Gourdeau and L. Archambault. 2020. Discriminative neural network for hero selection in professional Heroes of the Storm and DOTA 2. IEEE Transactions on Games(2020), 1–1.
[8]
F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) 5, 4(2015), 1–19.
[9]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2016. Session-based Recommendations with Recurrent Neural Networks. In ICLR 2016.
[10]
W. Kang and J. McAuley. 2018. Self-Attentive Sequential Recommendation. In 2018 IEEE International Conference on Data Mining (ICDM). 197–206. https://doi.org/10.1109/ICDM.2018.00035
[11]
W. Looi, M. Dhaliwal, R. Alhajj, and J. Rokne. 2018. Recommender System for Items in Dota 2. IEEE Transactions on Games(2018), 1–1. https://doi.org/10.1109/TG.2018.2844121
[12]
Marçal Mora-Cantallops and Miguel-Ángel Sicilia. 2018. MOBA games: A literature review. Entertainment computing 26 (2018), 128–138.
[13]
OpenAI, :, Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung, Przemysław Dębiak, Christy Dennison, David Farhi, Quirin Fischer, Shariq Hashme, Chris Hesse, Rafal Józefowicz, Scott Gray, Catherine Olsson, Jakub Pachocki, Michael Petrov, Henrique Pondé de Oliveira Pinto, Jonathan Raiman, Tim Salimans, Jeremy Schlatter, Jonas Schneider, Szymon Sidor, Ilya Sutskever, Jie Tang, Filip Wolski, and Susan Zhang. 2019. Dota 2 with Large Scale Deep Reinforcement Learning. arxiv:1912.06680 [cs.LG]
[14]
Zhiqiang Pan, Fei Cai, Wanyu Chen, Honghui Chen, and Maarten de Rijke. 2020. Star Graph Neural Networks for Session-Based Recommendation. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management(Virtual Event, Ireland) (CIKM ’20). Association for Computing Machinery, New York, NY, USA, 1195–1204. https://doi.org/10.1145/3340531.3412014
[15]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Vol. 32. Curran Associates, Inc.https://proceedings.neurips.cc/paper/2019/file/bdbca288fee7f92f2bfa9f7012727740-Paper.pdf
[16]
I. Porokhnenko, P. Polezhaev, and A. Shukhman. 2019. Machine Learning Approaches to Choose Heroes in Dota 2. In 2019 24th Conference of Open Innovations Association (FRUCT). 345–350.
[17]
Massimo Quadrana, Alexandros Karatzoglou, Balázs Hidasi, and Paolo Cremonesi. 2017. Personalizing Session-Based Recommendations with Hierarchical Recurrent Neural Networks. In Proceedings of the Eleventh ACM Conference on Recommender Systems (Como, Italy) (RecSys ’17). Association for Computing Machinery, New York, NY, USA, 130–137. https://doi.org/10.1145/3109859.3109896
[18]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (Montreal, Quebec, Canada) (UAI ’09). AUAI Press, Arlington, Virginia, USA, 452–461.
[19]
Mirna Paula Silva, Victor do Nascimento Silva, and Luiz Chaimowicz. 2017. Dynamic difficulty adjustment on MOBA games. Entertainment Computing 18 (Jan. 2017), 103–123. https://doi.org/10.1016/j.entcom.2016.10.002
[20]
Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (Beijing, China) (CIKM ’19). Association for Computing Machinery, New York, NY, USA, 1441–1450. https://doi.org/10.1145/3357384.3357895
[21]
Jiaxi Tang and Ke Wang. 2018. Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining(Marina Del Rey, CA, USA) (WSDM ’18). Association for Computing Machinery, New York, NY, USA, 565–573. https://doi.org/10.1145/3159652.3159656
[22]
Nava Tintarev and Judith Masthoff. 2011. Designing and evaluating explanations for recommender systems. In Recommender systems handbook. Springer, 479–510.
[23]
April Tyack, Peta Wyeth, and Daniel Johnson. 2016. The Appeal of MOBA Games: What Makes People Start, Stay, and Stop. In Proc. of the 2016 Annual Symposium on Computer-Human Interaction in Play (Austin, Texas, USA) (CHI PLAY ’16). ACM, New York, NY, USA, 313–325. https://doi.org/10.1145/2967934.2968098
[24]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention Is All You Need. In 31st Conference on Neural Information Processing Systems (Long Beach, CA, USA) (NIPS ’17).
[25]
Andrés Villa, Vladimir Araujo, Francisca Cattan, and Denis Parra. 2020. Interpretable Contextual Team-Aware Item Recommendation: Application in Multiplayer Online Battle Arena Games. In Fourteenth ACM Conference on Recommender Systems(Virtual Event, Brazil) (RecSys ’20). Association for Computing Machinery, New York, NY, USA, 503–508. https://doi.org/10.1145/3383313.3412211
[26]
Shoujin Wang, Liang Hu, Yan Wang, Longbing Cao, Quan Z Sheng, and Mehmet Orgun. 2019. Sequential recommender systems: challenges, progress and prospects. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. AAAI Press, 6332–6338.
[27]
Liwei Wu, Shuqing Li, Cho-Jui Hsieh, and James Sharpnack. 2020. SSE-PT: Sequential Recommendation Via Personalized Transformer. In Fourteenth ACM Conference on Recommender Systems (Virtual Event, Brazil) (RecSys ’20). Association for Computing Machinery, New York, NY, USA, 328–337. https://doi.org/10.1145/3383313.3412258
[28]
Xingxing Zhang, Furu Wei, and Ming Zhou. 2019. HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, 5059–5069. https://doi.org/10.18653/v1/P19-1499
[29]
Kun Zhou, Hui Wang, Wayne Xin Zhao, Yutao Zhu, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, and Ji-Rong Wen. 2020. S3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management (Virtual Event, Ireland) (CIKM ’20). Association for Computing Machinery, New York, NY, USA, 1893–1902. https://doi.org/10.1145/3340531.3411954

Cited By

View all
  • (2024)Avoiding Decision Fatigue with AI-Assisted Decision-MakingProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659569(1-11)Online publication date: 22-Jun-2024
  1. Hierarchical Transformers for Group-Aware Sequential Recommendation: Application in MOBA Games

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UMAP '22 Adjunct: Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization
    July 2022
    409 pages
    ISBN:9781450392327
    DOI:10.1145/3511047
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 July 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Item Recommendation
    2. MOBA Games
    3. Sequential Recommendation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    UMAP '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 162 of 633 submissions, 26%

    Upcoming Conference

    UMAP '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)42
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Avoiding Decision Fatigue with AI-Assisted Decision-MakingProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659569(1-11)Online publication date: 22-Jun-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media