skip to main content
10.1145/3240323.3241730acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
invited-talk

Hulu video recommendation: from relevance to reasoning

Published: 27 September 2018 Publication History

Abstract

Online Video Streaming services such as Hulu hosts tens of millions of premium videos, which requires an effective recommendation system to help viewers discover what they enjoy. In this talk, we will introduce Hulu's recent technical progresses in recommender systems and deep-dive into the topic of generating recommendation reason from knowledge graph. We have two user scenarios: the store-shelf and autoplay. The first requires a list of videos to maximize the chance that a viewer would pick one of them to watch. The second requires a sequence of video recommendations such that the viewer would continuously watch within the current session.
In the model layer, we designed specific models to match with each user scenario, balancing both exploitation and exploration. For example, we leverage the contextual-bandit model in the store-shelf scenario to adapt the ranking strategy to various types of user feedbacks. To optimize exploitation, we tested several granularity levels for parameter sharing among the arms. For more effective exploration, we incorporate Thomason sampling. For the autoplay scenario, we use a contextual recurrent neural network to predict the next video that the viewer is going to watch.
In the feature and data layer, we train embeddings for content, user and contextual info. For example, to train content embeddings, we collect factual tags from metadata, sentiment tags from reviews, and keywords from the captions and object/action recognized using computer vision techniques.
Next we will deep-dive into one important topic: generating recommendation reason from knowledge graph.
A fact is defined by a tuple of related entities and their relation, which is normally a pair of entities tagged by a relationship. In our problem setting, recommendation results are the targets, viewed as inputs for the reasoning task, consisting of pairs of relevant entities, i.e. a source node and a destination node in a knowledge graph. The recommendation reasoning task is to learn a path or a small directed acyclic subgraph, connecting the source node to the destination node.
Since the facts in a knowledge graph have different confidence values for different reasoned targets, we need to conduct a probabilistic inference. The challenge is we do not know a predefined set of logic rules to guide the search through the knowledge graph, which prevents us from directly applying the probabilistic logic methods. Inspired by recent advances in deep learning and reinforcement learning, especially in graph neural networks, attention mechanism and deep generative models, we propose two ways to model the reasoning process: the differentiable reasoning approach and the stochastic reasoning approach.
Differentiable reasoning approaches are based on graph neural networks [1,2] with attention flow and information flow. The attention dynamics is an iterative process of redistributing and aggregating attention over the knowledge graph, starting at the source node. The final attention aggregated at the destination node serves for the prediction to compute the loss. Instead of the prediction accuracy, we care more about how the learned attention dynamics draws its reasoning track in a knowledge graph.
Stochastic reasoning approaches frame the reasoning process as learning a probabilistic graphical model consisting of stochastic discrete operations, such as selecting a node and selecting an edge, to build a reason subgraph extracted from the knowledge graph. The model is known as stochastic computation graphs (SCGs), and to learn it, we propose a generalized back-propagation framework Backprop-Q [3] to overcome the gradient-blocking issues in applying standard back-propagation. In summary, we give an overview of the recommendation research in Hulu and deep-dive into our differentiable reasoning approach and stochastic reasoning approach for generating recommendation reasons based on a knowledge graph.

Supplementary Material

MP4 File (p482-xu.mp4)

References

[1]
Yujia Li, Daniel Tarlow, Marc Brockschmidt, Richard Zemel (2015). Gated Graph Sequence Neural Networks, arXiv:1511.05493.
[2]
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò and Yoshua Bengio (2017). Graph Attention Networks, arXiv preprint arXiv:1710.10903.
[3]
Xiaoran Xu, Songpeng Zu and Hanning Zhou (2018). Backprop-Q: Generalized Backpropagation for Stochastic Computation Graphs, arXiv preprint arXiv:1807.09511.

Cited By

View all
  • (2024)Knowledge graph-based recommendation with knowledge noise reduction and data augmentationApplied Intelligence10.1007/s10489-024-05657-x54:21(10333-10359)Online publication date: 13-Aug-2024
  • (2022)Multi-Modal Variational Graph Auto-Encoder for Recommendation SystemsIEEE Transactions on Multimedia10.1109/TMM.2021.311148724(1067-1079)Online publication date: 2022
  • (2021)A Behavior-Aware Graph Convolution Network Model for Video RecommendationWeb and Big Data10.1007/978-3-030-85899-5_21(279-294)Online publication date: 19-Aug-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems
September 2018
600 pages
ISBN:9781450359016
DOI:10.1145/3240323
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2018

Check for updates

Author Tags

  1. hulu
  2. reasoning
  3. recommender system

Qualifiers

  • Invited-talk

Conference

RecSys '18
Sponsor:
RecSys '18: Twelfth ACM Conference on Recommender Systems
October 2, 2018
British Columbia, Vancouver, Canada

Acceptance Rates

RecSys '18 Paper Acceptance Rate 32 of 181 submissions, 18%;
Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Knowledge graph-based recommendation with knowledge noise reduction and data augmentationApplied Intelligence10.1007/s10489-024-05657-x54:21(10333-10359)Online publication date: 13-Aug-2024
  • (2022)Multi-Modal Variational Graph Auto-Encoder for Recommendation SystemsIEEE Transactions on Multimedia10.1109/TMM.2021.311148724(1067-1079)Online publication date: 2022
  • (2021)A Behavior-Aware Graph Convolution Network Model for Video RecommendationWeb and Big Data10.1007/978-3-030-85899-5_21(279-294)Online publication date: 19-Aug-2021
  • (2020)Sequential Multi-fusion Network for Multi-channel Video CTR PredictionDatabase Systems for Advanced Applications10.1007/978-3-030-59419-0_1(3-18)Online publication date: 22-Sep-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media