skip to main content
10.1145/3292500.3330750acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Characterizing and Forecasting User Engagement with In-App Action Graph: A Case Study of Snapchat

Published: 25 July 2019 Publication History

Abstract

While mobile social apps have become increasingly important in people's daily life, we have limited understanding on what motivates users to engage with these apps. In this paper, we answer the question whether users' in-app activity patterns help inform their future app engagement (e.g., active days in a future time window)? Previous studies on predicting user app engagement mainly focus on various macroscopic features (e.g., time-series of activity frequency), while ignoring fine-grained inter-dependencies between different in-app actions at the microscopic level. Here we propose to formalize individual user's in-app action transition patterns as a temporally evolving action graph, and analyze its characteristics in terms of informing future user engagement. Our analysis suggested that action graphs are able to characterize user behavior patterns and inform future engagement. We derive a number of high-order graph features to capture in-app usage patterns and construct interpretable models for predicting trends of engagement changes and active rates. To further enhance predictive power, we design an end-to-end, multi-channel neural model to encode both temporal action graphs, activity sequences, and other macroscopic features. Experiments on predicting user engagement for 150k Snapchat new users over a 28-day period demonstrate the effectiveness of the proposed prediction models. The analysis and prediction framework is also deployed at Snapchat to deliver real world business insights. Our proposed framework is also general and can be applied to any online platform.

References

[1]
Tim Althoff and Jure Leskovec. 2015. Donor retention in online crowdfunding communities: A case study of donorschoose. org. In WWW.
[2]
Wai-Ho Au, Keith CC Chan, and Xin Yao. 2003. A novel evolutionary data mining algorithm with applications to churn prediction. IEEE transactions on evolutionary computation 7, 6 (2003), 532--545.
[3]
Ricardo Baeza-Yates, Carlos Hurtado, Marcelo Mendoza, and Georges Dupret. 2005. Modeling user search behavior. In Web Congress. IEEE.
[4]
Fabrício Benevenuto, Tiago Rodrigues, Meeyoung Cha, and Virgílio Almeida. 2009. Characterizing user behavior in online social networks. In SIGCOMM.
[5]
Austin R Benson, Ravi Kumar, and Andrew Tomkins. 2016. Modeling user consumption sequences. In WWW.
[6]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. J. Mach. Learn. Res. 3 (March 2003), 993--1022.
[7]
Paolo Boldi, Francesco Bonchi, Carlos Castillo, Debora Donato, Aristides Gionis, and Sebastiano Vigna. 2008. The query-flow graph: model and applications. In CIKM.
[8]
Justin Cheng, Caroline Lo, and Jure Leskovec. 2017. Predicting intent using activity logs: How goal specificity and temporal range affect user behavior. In WWW.
[9]
Giovanni Luca Ciampaglia and Dario Taraborelli. 2015. MoodBar: Increasing new user retention in Wikipedia through lightweight socialization. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 734--742.
[10]
?ule Gündüz and M Tamer Özsu. 2003. A web page prediction model based on click-stream tree representation of user behavior. In KDD.
[11]
Aaron Halfaker, Oliver Keyes, Daniel Kluver, Jacob Thebault-Spieker, Tien Nguyen, Kenneth Shores, Anuradha Uduwage, and Morten Warncke-Wang. 2015. User session identification based on strong regularities in inter-activity time. In WWW.
[12]
Ahmed Hassan, Rosie Jones, and Kristina Lisa Klinkner. 2010. Beyond DCG: user behavior as a predictor of a successful search. In WSDM.
[13]
Komal Kapoor, Mingxuan Sun, Jaideep Srivastava, and Tao Ye. 2014. A hazard based approach to user return time prediction. In KDD.
[14]
Jaya Kawale, Aditya Pal, and Jaideep Srivastava. 2009. Churn prediction in MMORPGs: A social influence based approach. In CSE, Vol. 4. IEEE, 423--428.
[15]
Thomas N Kipf and MaxWelling. 2016. Semi-supervised classification with graph convolutional networks. arXiv:1609.02907 (2016).
[16]
Zhiyuan Lin, Tim Althoff, and Jure Leskovec. 2018. I'll Be Back: On the Multiple Lives of Users of a Mobile Activity Tracking Application. In WWW.
[17]
Caroline Lo, Dan Frankowski, and Jure Leskovec. 2016. Understanding behaviors that lead to purchasing: A case study of pinterest. In KDD.
[18]
Narayanan Sadagopan and Jie Li. 2008. Characterizing typical and atypical user sessions in clickstreams. In WWW.
[19]
William Trouleau, Azin Ashkan, Weicong Ding, and Brian Eriksson. 2016. Just one more: Modeling binge watching behavior. In KDD.
[20]
Gang Wang, Xinyi Zhang, Shiliang Tang, Christo Wilson, Haitao Zheng, and Ben Y Zhao. 2017. Clickstream user behavior models. ACM Transactions on the Web 11, 4 (2017), 21.
[21]
Carl Yang, Xiaolin Shi, Luo Jie, and Jiawei Han. 2018. I Know You'll Be Back: Interpretable New User Clustering and Churn Prediction on a Mobile Social Application. In KDD.
[22]
Jiang Yang, Xiao Wei, Mark S Ackerman, and Lada A Adamic. 2010. Activity Lifespan: An Analysis of User Survival Patterns in Online Knowledge Sharing Communities. ICWSM (2010).

Cited By

View all
  • (2025)CrysToGraph: A Comprehensive Predictive Model for Crystal Material Properties and the BenchmarkBattery Energy10.1002/bte2.70004Online publication date: 26-Feb-2025
  • (2024)TIM: Temporal Interaction Model in Notification SystemProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3657614(1120-1124)Online publication date: 30-May-2024
  • (2024)Predicting wildfire events with calibrated probabilitiesProceedings of the 2024 16th International Conference on Machine Learning and Computing10.1145/3651671.3651708(168-175)Online publication date: 2-Feb-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
July 2019
3305 pages
ISBN:9781450362016
DOI:10.1145/3292500
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. action graph
  2. app usage pattern
  3. graph neural network
  4. time-series model
  5. user engagement prediction

Qualifiers

  • Research-article

Conference

KDD '19
Sponsor:

Acceptance Rates

KDD '19 Paper Acceptance Rate 110 of 1,200 submissions, 9%;
Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Upcoming Conference

KDD '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)76
  • Downloads (Last 6 weeks)6
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)CrysToGraph: A Comprehensive Predictive Model for Crystal Material Properties and the BenchmarkBattery Energy10.1002/bte2.70004Online publication date: 26-Feb-2025
  • (2024)TIM: Temporal Interaction Model in Notification SystemProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3657614(1120-1124)Online publication date: 30-May-2024
  • (2024)Predicting wildfire events with calibrated probabilitiesProceedings of the 2024 16th International Conference on Machine Learning and Computing10.1145/3651671.3651708(168-175)Online publication date: 2-Feb-2024
  • (2024)General-Purpose User Modeling with Behavioral Logs: A Snapchat Case StudyProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657908(2431-2436)Online publication date: 10-Jul-2024
  • (2024)Fine-Grained Spatio-Temporal Distribution Prediction of Mobile Content Delivery in 5G Ultra-Dense NetworksIEEE Transactions on Mobile Computing10.1109/TMC.2022.322644823:1(469-482)Online publication date: Jan-2024
  • (2024)Temporal Graph Multi-Aspect EmbeddingsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.339749136:11(7102-7114)Online publication date: 1-Nov-2024
  • (2024)Informative Subgraphs Aware Masked Auto-Encoder in Dynamic Graphs2024 IEEE International Conference on Data Mining (ICDM)10.1109/ICDM59182.2024.00023(161-170)Online publication date: 9-Dec-2024
  • (2024)Predicting Fall Events by a Spatio-Temporal Topological Network with Multiple Wearable SensorsICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10446493(8551-8555)Online publication date: 14-Apr-2024
  • (2024)A Software-Programmable Neural Processing Unit for Graph Neural Network Inference on FPGAs2024 34th International Conference on Field-Programmable Logic and Applications (FPL)10.1109/FPL64840.2024.00034(187-196)Online publication date: 2-Sep-2024
  • (2024)Temporal dynamics unleashed: Elevating variational graph attentionKnowledge-Based Systems10.1016/j.knosys.2024.112110299(112110)Online publication date: Sep-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media