Abstract
Recommendation systems can play an important role in today’s digital content platforms by supporting the suggestion of relevant content in a personalised manner for each customer. Such content customisation has not been consistent across most media domains, and particularly on radio streaming and gaming aggregators, which are the two real-world application domains focused in this work. The challenges faced in these application areas are the dynamic nature of user preferences and the difficulty of generating recommendations for less popular content, due to the overwhelming choice and polarisation of available top content. We present the design and implementation of a Reinforcement Learning-based Recommendation System (RLRS) for web applications, using a Deep Deterministic Policy Gradient (DDPG) agent and, as a reward function, a weighted sum of the user Click Distribution (CD) across the recommended items and the Dwell Time (DT), a measure of the time users spend interacting with those items. Our system has been deployed in real production scenarios with preliminary but promising results. Several metrics are used to track the effectiveness of our approach, such as content coverage, category diversity, and intra-list similarity. In both scenarios tested, the system shows consistent improvement and adaptability over time, reinforcing its applicability.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Afsar, M.M., Crump, T., Far, B.: Reinforcement learning based recommender systems: a survey. ACM Computing Surveys (CSUR), pp. 1–37, December 2022. https://doi.org/10.1145/3543846
Anderson, C.: The long tail: why the future of business is selling less of more. Hyperion, New York (2008)
AppGeneration: myTuner radio app (2024). https://mytuner-radio.com. Accessed 01 Feb 2024
AppGeneration: Reludi online games (2024). https://www.reludi.com. Accessed 01 Feb 2024
Chen, X., Li, S., Li, H., Jiang, S., Qi, Y., Song, L.: Generative adversarial user model for reinforcement learning based recommendation system. In: Proceedings of the 36th International Conference on Machine Learning, pp. 1–10 (2019)
Dulac-Arnold, G., et al.: Deep reinforcement learning in large discrete action spaces. CoRR, pp. 1–11, December 2015. arxiv: org/abs/1512.07679
Jahromi, H.Z., Delaney, D., Hines, A.: A sign of things to come: Predicting the perception of above-the-fold time in web browsing. Future Internet 13(2) (2021). https://doi.org/10.3390/fi13020050
Jannach, D., Pu, P., Ricci, F., Zanker, M.: Recommender systems: Past, present, future. AI Mag. 42(3), 3–6 (2021)
Jesse, M., Bauer, C., Jannach, D.: Intra-list similarity and human diversity perceptions of recommendations: the details matter. User Modeling User-Adapted Interact. 33 (2022)
Liu, F., et al.: Deep reinforcement learning based recommendation with explicit user-item interactions modeling. arXiv preprint arXiv:1810.12027, pp. 1–11 (2019)
LUMINATE: Luminate Year-End Music Report. Tech. rep., LUMINATE, United States (2022)
Wang, K., et al.: Rl4rs: a real-world dataset for reinforcement learning based recommender system (2023)
Wang, X., Wang, D., Xu, C., He, X., Cao, Y., Chua, T.S.: Explainable reasoning over knowledge graphs for recommendation. In: Proceedings of the AAAI Conference on Artificial Intelligence (2019). https://ojs.aaai.org/index.php/AAAI/article/view/4470
Zhao, X., Zhang, L., Ding, Z., Yin, D., Zhao, Y., Tang, J.: Deep reinforcement learning for list-wise recommendations. In: Deep Reinforcement Learning for List-wise Recommendations 1828, pp. 89–93 (2019)
Zheng, G., Zhang, F., Zheng, Z., Xiang, Y., Yuan, N.J., Xie, X., Li, Z.: Drn: A deep reinforcement learning framework for news recommendation. In: The 2018 World Wide Web Conference (2018)
Acknowledgements
This work was financially supported by: Base Funding - UIDB/00027/2020 and Programmatic Funding - UIDP/00027/2020 of the Artificial Intelligence and Computer Science Laboratory - LIACC - funded by national funds through the FCT/MCTES (PIDDAC).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Batista, A., Torres, J.M., Sobral, P., Moreira, R.S., Soares, C., Pereira, I. (2025). A Reinforcement Learning Based Recommender System Framework for Web Apps: Radio and Game Aggregators Scenarios. In: Santos, M.F., Machado, J., Novais, P., Cortez, P., Moreira, P.M. (eds) Progress in Artificial Intelligence. EPIA 2024. Lecture Notes in Computer Science(), vol 14967. Springer, Cham. https://doi.org/10.1007/978-3-031-73497-7_34
Download citation
DOI: https://doi.org/10.1007/978-3-031-73497-7_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-73496-0
Online ISBN: 978-3-031-73497-7
eBook Packages: Computer ScienceComputer Science (R0)