skip to main content
10.1145/3366424.3382728acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Time Series Forecasting for Cold-Start Items by Learning from Related Items using Memory Networks

Published: 20 April 2020 Publication History

Abstract

Time series forecasting for new items is very important in a wide variety of applications. Existing solutions for time series forecasting, however, do not address this cold start problem. The underlying machine learning models in these solutions rely heavily on the availability of the past data points of the time series. Here, we propose to use a modified Dynamic Key-Value Memory Network (DKVMN) that enables knowledge sharing across items. The network is conventionally used for binary tasks in knowledge tracing. We modify it for our regression-based forecasting use-case. Specifically, we change the output layer, include feedback for error correction, add a mechanism to handle scale across items. We test our solution on the SKU level data of a large e-commerce company and compare the results to the widely used LSTM model, outperforming it by over 25% across multiple metrics.

References

[1]
Kasun Bandara, Christoph Bergmeir, and Slawek Smyl. 2020. Forecasting across time series databases using recurrent neural networks on groups of similar series: A clustering approach. Expert Systems with Applications 140 (2020), 112896.
[2]
Kasun Bandara, Peibei Shi, Christoph Bergmeir, Hansika Hewamalage, Quoc Tran, and Brian Seaman. 2019. Sales Demand Forecast in E-commerce using a Long Short-Term Memory Neural Network Methodology. arXiv preprint arXiv:1901.04028(2019).
[3]
Nikolay Laptev, Jason Yosinski, Li Erran Li, and Slawek Smyl. 2017. Time-series extreme event forecasting with neural networks at uber. In International Conference on Machine Learning, Vol. 34. 1–5.
[4]
Weizhong Yan. 2012. Toward automatic time-series forecasting using neural networks. IEEE Transactions on Neural Networks and Learning Systems 23, 7(2012), 1028–1039.
[5]
Jiani Zhang, Xingjian Shi, Irwin King, and Dit-Yan Yeung. 2017. Dynamic key-value memory networks for knowledge tracing. In Proceedings of the 26th international conference on World Wide Web. International World Wide Web Conferences Steering Committee, 765–774.
[6]
Hans-Georg Zimmermann, Christoph Tietz, and Ralph Grothmann. 2012. Forecasting with recurrent neural networks: 12 tricks. In Neural Networks: Tricks of the Trade. Springer, 687–707.

Cited By

View all
  • (2024)S$^\text{3}$Attention: Improving Long Sequence Attention With Smoothed Skeleton SketchingIEEE Journal of Selected Topics in Signal Processing10.1109/JSTSP.2024.344617318:6(985-996)Online publication date: Sep-2024
  • (2023) S: Adaptive anomaly detection on sporadic data streams Computer Communications10.1016/j.comcom.2023.06.027209(151-162)Online publication date: Sep-2023
  • (2022)Incorporating neighborhood features in RNNs for popularity forecasting for emerging research fields2022 IEEE 9th International Conference on Data Science and Advanced Analytics (DSAA)10.1109/DSAA54385.2022.10032444(1-10)Online publication date: 13-Oct-2022

Index Terms

  1. Time Series Forecasting for Cold-Start Items by Learning from Related Items using Memory Networks
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        WWW '20: Companion Proceedings of the Web Conference 2020
        April 2020
        854 pages
        ISBN:9781450370240
        DOI:10.1145/3366424
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 20 April 2020

        Permissions

        Request permissions for this article.

        Check for updates

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        WWW '20
        Sponsor:
        WWW '20: The Web Conference 2020
        April 20 - 24, 2020
        Taipei, Taiwan

        Acceptance Rates

        Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)24
        • Downloads (Last 6 weeks)2
        Reflects downloads up to 02 Mar 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)S$^\text{3}$Attention: Improving Long Sequence Attention With Smoothed Skeleton SketchingIEEE Journal of Selected Topics in Signal Processing10.1109/JSTSP.2024.344617318:6(985-996)Online publication date: Sep-2024
        • (2023) S: Adaptive anomaly detection on sporadic data streams Computer Communications10.1016/j.comcom.2023.06.027209(151-162)Online publication date: Sep-2023
        • (2022)Incorporating neighborhood features in RNNs for popularity forecasting for emerging research fields2022 IEEE 9th International Conference on Data Science and Advanced Analytics (DSAA)10.1109/DSAA54385.2022.10032444(1-10)Online publication date: 13-Oct-2022

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media