skip to main content
10.1145/3240323.3241728acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
invited-talk

Adapting session based recommendation for features through transfer learning

Published: 27 September 2018 Publication History

Abstract

This industry talk covers the deep learning architecture developed at Realtor.com to recommend real estate listings to our userbase. The recommendation of homes is a different problem than most other domains both in the sense that listings are unique and that there are additional geographic and time constraints that increase the sparsity of interactions and make recommendation of individual listings more challenging. In particular time on market in a hot area can be limited to weeks or even days, and listing cold-start is critical to providing up to date market information. Thankfully the structured feature data for listings is incredibly rich and provides a framework from which to map listings into a meaningful vector space. User first impressions are also incredibly important in this highly competitive field, and offline recommendation or models that don't adapt during the users session are less desirable.
In order to solve this recommendation problem we have developed a model based off of session based recommendation [1]. The architecture utilizes state of the art techniques from Natural Language Processing, including the AWD-LSTM language model developed by Salesforce [2]. To solve for cold-start of listings a structured data based denoising autoencoder was adapted from the methodology described in the winning entry of the Puerto Segurno Safe Driver Kaggle Competition [3]. This model is not used in the common way of generating fixed feature vectors, but rather the entire head of the autoencoder model, from the feature inputs to the middle layer commonly used as the vector output, is first trained to encode listing features, and then becomes the input to the AWD-LSTM architecture. This style of transfer learning is common in Computer Vision, and has recently been utilized in NLP to achieve state of the art results for text classification [4]. By including the head we are able to further optimize the listing encoder network and embeddings to take user interactions into account. As in traditional session based recommendation users are represented as the sequence of listings that they view, however those listings are fed into the model as the sequence of features.
The final system consists of several components. The first attempts to calculate and maintain the users' feature vector and model hidden weights in near realtime, providing a representation for the user within the system. This representation is used by several downstream components, most notably the search rerank and recommendation modules which calculate users' interest in listings both in the context of the output of more traditional elasticsearch queries via cosine similarity of user/listing vectors and through approximate nearest neighbor vector space searches for relevant listings which form the input set for a pointwise scoring model trained on time on listing as done by YouTube [5].

Supplementary Material

MP4 File (p481-oldridge.mp4)

References

[1]
Hidasi, Karatzoglou, Baltrunas, Tikk - Session-based Recommendations with Recurrent Neural Networks. In ICLR 2016
[2]
Merity, Keskar and Socher - Regularizing and Optimizing LSTM Language Models.
[3]
1<sup>st</sup> place with representation learning. htps://www.kaggle.com/c/porto-seguro-safe-driver-prediction/discussion/44629#250927
[4]
Howard, Ruder - Fine-tuned Language Models for Text Classification. In Covington, Adams, Sargin - Deep Neural Networks for YouTube Recommendations

Cited By

View all
  • (2019)Domain adaptation in display advertisingProceedings of the 13th ACM Conference on Recommender Systems10.1145/3298689.3347004(178-186)Online publication date: 10-Sep-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems
September 2018
600 pages
ISBN:9781450359016
DOI:10.1145/3240323
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2018

Check for updates

Author Tags

  1. deep learning
  2. recommender systems
  3. transfer learning

Qualifiers

  • Invited-talk

Conference

RecSys '18
Sponsor:
RecSys '18: Twelfth ACM Conference on Recommender Systems
October 2, 2018
British Columbia, Vancouver, Canada

Acceptance Rates

RecSys '18 Paper Acceptance Rate 32 of 181 submissions, 18%;
Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)2
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2019)Domain adaptation in display advertisingProceedings of the 13th ACM Conference on Recommender Systems10.1145/3298689.3347004(178-186)Online publication date: 10-Sep-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media