skip to main content
10.1145/3523227.3547491acmotherconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
invited-talk

A Lightweight Transformer for Next-Item Product Recommendation

Published: 13 September 2022 Publication History

Abstract

We apply a transformer using sequential browse history to generate next-item product recommendations. Interpreting the learned item embeddings, we show that the model is able to implicitly learn price, popularity, style and functionality attributes without being explicitly passed these features during training. Our real-life test of this model on Wayfair’s different international stores show mixed results (but overall win). Diagnosing the cause, we identify a useful metric (average number of customers browsing each product) to ensure good model convergence. We also find limitations of using standard metrics like recall and nDCG, which do not correctly account for the positional effects of showing items on the Wayfair website, and empirically determine a more accurate discount factor.

Supplementary Material

MOV File (A_Lightweight_Transformer_For_Next_Item_Product_Recommendation.mov)
Video - 'A Lightweight Transformer for Next-Item Product Recommendation'. In this talk, we present our latest model for next-item product recommendation using a sequential input of a customers' browsing history. We show that the standard log discount in nDCG is insufficiently strong for our real observed positional effect, suggest a way to determine a better discount empirically. We also show that our model is very plausibly learning to distinguish different item style/functionality/material and can even connect different types of furniture to provide cross-category recommendation. Lastly, we show that the ratio of customers viewing each distinct item in a catalog can be used to diagnose thin data issues and align model performance across different catalogs.
MP4 File (A_Lightweight_Transformer_For_Next_Item_Product_Recommendation.mp4)
Presentation Video for "A Lightweight Transformer for Next-Item Product Recommendation". We apply a transformer using sequential browse history to generate next-item product recommendations. Interpreting the learned item embeddings, we show that the model is able to implicitly learn price, popularity, style and functionality attributes without being explicitly passed these features during training. We also show that these attributes transfer across different types of furniture. Our real-life test of this model on Wayfair?s different international stores show mixed results (but overall win). Diagnosing the cause, we identify a useful metric (average number of customers browsing each product) to ensure good model convergence. We also find limitations of using standard metrics like recall and nDCG, which do not correctly account for the positional effects of showing items on the Wayfair website, and empirically determine a more accurate discount factor.

References

[1]
Hao Jiang, Aakash Sabharwal, Adam Henderson, Diane Hu, and Liangjie Hong. 2019. Understanding the Role of Style in E-commerce Shopping. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 3112–3120.
[2]
Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive Sequential Recommendation. In 2018 IEEE International Conference on Data Mining (ICDM). IEEE, 197–206.
[3]
Leland McInnes, John Healy, Nathaniel Saul, and Lukas Großberger. 2018. UMAP: Uniform Manifold Approximation and Projection. Journal of Open Source Software 3, 29 (2018).
[4]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention Is All You Need. Advances in neural information processing systems 30 (2017).
[5]
Ellen M Voorhees 1999. The TREC-8 Question Answering Track Report. In TREC, Vol. 99. 77–82.

Cited By

View all
  • (2023)Station and Track Attribute-Aware Music PersonalizationProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3610239(1031-1035)Online publication date: 14-Sep-2023
  • (2023)Scaling Session-Based Transformer Recommendations using Optimized Negative Sampling and Loss FunctionsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3610236(1023-1026)Online publication date: 14-Sep-2023
  • (2023)A Probabilistic Position Bias Model for Short-Video Recommendation FeedsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608777(675-681)Online publication date: 14-Sep-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
RecSys '22: Proceedings of the 16th ACM Conference on Recommender Systems
September 2022
743 pages
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2022

Check for updates

Author Tags

  1. style
  2. transformers

Qualifiers

  • Invited-talk
  • Research
  • Refereed limited

Conference

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)76
  • Downloads (Last 6 weeks)9
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Station and Track Attribute-Aware Music PersonalizationProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3610239(1031-1035)Online publication date: 14-Sep-2023
  • (2023)Scaling Session-Based Transformer Recommendations using Optimized Negative Sampling and Loss FunctionsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3610236(1023-1026)Online publication date: 14-Sep-2023
  • (2023)A Probabilistic Position Bias Model for Short-Video Recommendation FeedsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608777(675-681)Online publication date: 14-Sep-2023
  • (2023)Communicative MARL-based Relevance Discerning Network for Repetition-Aware RecommendationProceedings of the ACM Web Conference 202310.1145/3543507.3583459(1231-1239)Online publication date: 30-Apr-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media