skip to main content
10.1145/2987538.2987543acmotherconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
research-article

Job recommendation with Hawkes process: an effective solution for RecSys Challenge 2016

Authors Info & Claims
Published:15 September 2016Publication History

ABSTRACT

The RecSys Challenge 2016 focuses on the prediction of users' interest in clicking a job posting in the career-oriented social networking site Xing. Given users' profile, the content of the job posting, as well as the historical activities of users, we aim in recommending top job postings to users for the coming week. This paper introduces the winning strategy for such a recommendation task. We summarize several key components that result in our leading position in this contest. First, we build a hierarchical pairwise model with ensemble learning as the overall prediction framework. Second, we integrate both content and behavior information in our feature engineering process. In particular, we model the temporal activity pattern using a self-exciting point process, namely Hawkes Process, to generate the most relevant recommendation at the right moment. Finally, we also tackle the challenging cold start issue using a semantic based strategy that is built on the topic modeling with the users profiling information. Our approach achieved the highest leader-board and full scores among all the submissions.

References

  1. O. Aalen, O. Borgan, and H. Gjessing. Survival and event history analysis: a process point of view. Springer Science & Business Media, 2008.Google ScholarGoogle Scholar
  2. F. Abel, A. Benczúr, D. Kohlsdorf, M. Larson, and R. Pálovics. Recsys challenge 2016: Job recommendations. In Proceedings of the 2016 International ACM Recommender Systems, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. J. Bennett and S. Lanning. The netflix prize. In Proceedings of KDD cup and workshop, volume 2007, page 35, 2007.Google ScholarGoogle Scholar
  4. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. Journal of machine Learning research, 3(Jan):993--1022, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. R. Burke. Hybrid web recommender systems. In The adaptive web, pages 377--408. Springer, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. T. G. Dietterich. Ensemble learning. The handbook of brain theory and neural networks, 2:110--125, 2002.Google ScholarGoogle Scholar
  7. N. Du, M. Farajtabar, A. Ahmed, A. J. Smola, and L. Song. Dirichlet-hawkes processes with applications to clustering continuous-time document streams. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 219--228. ACM, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. N. Du, L. Song, H. Woo, and H. Zha. Uncover topic-sensitive information diffusion networks. In Proceedings of the sixteenth international conference on artificial intelligence and statistics, pages 229--237, 2013.Google ScholarGoogle Scholar
  9. N. Du, Y. Wang, N. He, J. Sun, and L. Song. Time-sensitive recommendation from recurrent user activities. In Advances in Neural Information Processing Systems, pages 3492--3500, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. H. Friedman. Stochastic gradient boosting. Computational Statistics & Data Analysis, 38(4):367--378, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. A. G. Hawkes. Spectra of some self-exciting and mutually exciting point processes. Biometrika, 58(1):83--90, 1971.Google ScholarGoogle ScholarCross RefCross Ref
  12. C. G. ianqi Chen. Xgboost: A scalable tree boosting system. In Proceedings of the 22th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. T.-Y. Liu. Learning to rank for information retrieval. Foundations and Trends in Information Retrieval, 3(3):225--331, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. M. J. Pazzani and D. Billsus. Content-based recommendation systems. In The adaptive web, pages 325--341. Springer, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. F. Ricci, L. Rokach, and B. Shapira. Introduction to recommender systems handbook. Springer, 2011.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. P. Romov and E. Sokolov. Recsys challenge 2015: ensemble learning with categorical features. In Proceedings of the 2015 International ACM Recommender Systems Challenge, page 1. ACM, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. J. B. Schafer, D. Frankowski, J. Herlocker, and S. Sen. Collaborative filtering recommender systems. In The adaptive web, pages 291--324. Springer, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. I. Valera and M. Gomez-Rodriguez. Modeling adoption and usage of competing products. In Data Mining (ICDM), 2015 IEEE International Conference on, pages 409--418. IEEE, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. J. Wang, K. R. Varshney, and A. Mojsilovic. Legislative prediction via random walks over a heterogeneous graph. In SDM, pages 1095--1106. SIAM, 2012.Google ScholarGoogle Scholar
  20. Z. Zheng, K. Chen, G. Sun, and H. Zha. A regression framework for learning ranking functions using relative relevance judgments. In Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 287--294. ACM, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Z.-H. Zhou, J. Wu, and W. Tang. Ensembling neural networks: many could be better than all. Artificial intelligence, 137(1):239--263, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Job recommendation with Hawkes process: an effective solution for RecSys Challenge 2016

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          RecSys Challenge '16: Proceedings of the Recommender Systems Challenge
          September 2016
          51 pages
          ISBN:9781450348010
          DOI:10.1145/2987538

          Copyright © 2016 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 15 September 2016

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          RecSys Challenge '16 Paper Acceptance Rate11of15submissions,73%Overall Acceptance Rate11of15submissions,73%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader