Skip to main content

When Multitask Learning Make a Difference: Spatio-Temporal Joint Prediction for Cellular Trajectories

  • Conference paper
  • First Online:
Database Systems for Advanced Applications (DASFAA 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13245))

Included in the following conference series:

Abstract

Spatio-temporal joint prediction aims to simultaneously predict the next location and the corresponding switch time for a cellular trajectory. It requires to consider not only the mutual influence of spatio-temporal predicting tasks, but also the signals related to the intentions of the travel. Although multitask learning can support the joint prediction by considering both spatio-temporal signals, existing approaches neglect the effects of travel intentions and fail to model the long-term dependencies in trajectory, resulting in sub-optimal results accordingly. To solve these issues, we propose an intention-aware multitask learning method for spatio-temporal joint prediction, such that predicting travel intention is learned as an auxiliary task. Specifically, due to the implicity of travel intention, we design an effective loss function to learn meaningful intention representation, which can capture trajectory’s future moving goal, so as to provide long-term information for spatio-temporal joint prediction. Furthermore, we carefully design a gating mechanism to fuse sequential and intentional information with different weights to reflect their importance in capturing current movement status. Besides, self-attention network is adopted to model the long-term dependencies of far sampling points in a dense trajectory. Finally, extensive experiments on two trajectory datasets demonstrate the superiority of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aalen, O., Borgan, O., Gjessing, H.: Survival and Event History Analysis: A Process Point of View. Springer, New York (2008). https://doi.org/10.1007/978-0-387-68560-1

    Book  MATH  Google Scholar 

  2. Ba, L.J., Kiros, J.R., Hinton, G.E.: Layer normalization. CoRR abs/1607.06450 (2016)

    Google Scholar 

  3. Blondel, V.D., Decuyper, A., Krings, G.: A survey of results on mobile phone datasets analysis. EPJ Data Sci. 4(1), 1–55 (2015). https://doi.org/10.1140/epjds/s13688-015-0046-0

    Article  Google Scholar 

  4. Du, N., Dai, H., Trivedi, R., Upadhyay, U., Gomez-Rodriguez, M., Song, L.: Recurrent marked temporal point processes: embedding event history to vector. In: SIGKDD, pp. 1555–1564 (2016)

    Google Scholar 

  5. Feng, J., et al.: Deepmove: predicting human mobility with attentional recurrent networks. In: WWW, pp. 1459–1468 (2018)

    Google Scholar 

  6. Gu, Y.: Attentive neural point processes for event forecasting. In: AAAI, pp. 7592–7600 (2021)

    Google Scholar 

  7. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR, pp. 770–778 (2016)

    Google Scholar 

  8. Kong, D., Wu, F.: HST-LSTM: a hierarchical spatial-temporal long-short term memory network for location prediction. In: IJCAI, pp. 2341–2347 (2018)

    Google Scholar 

  9. Liang, W., Zhang, W.: Learning social relations and spatiotemporal trajectories for next check-in inference. TNNLS (2020)

    Google Scholar 

  10. Liu, Q., Wu, S., Wang, L., Tan, T.: Predicting the next location: a recurrent model with spatial and temporal contexts. In: AAAI, pp. 194–200 (2016)

    Google Scholar 

  11. Luca, M., Barlacchi, G., Lepri, B., Pappalardo, L.: Deep learning for human mobility: a survey on data and models. CoRR abs/2012.02825 (2020)

    Google Scholar 

  12. Luong, M., Le, Q.V., Sutskever, I., Vinyals, O., Kaiser, L.: Multi-task sequence to sequence learning. In: ICLR (2016)

    Google Scholar 

  13. Lv, Z., Xu, J., Zhao, P., Liu, G., Zhao, L., Zhou, X.: Outlier trajectory detection: a trajectory analytics based approach. In: Candan, S., Chen, L., Pedersen, T.B., Chang, L., Hua, W. (eds.) DASFAA 2017. LNCS, vol. 10177, pp. 231–246. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-55753-3_15

    Chapter  Google Scholar 

  14. Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized Markov chains for next-basket recommendation. In: WWW, pp. 811–820 (2010)

    Google Scholar 

  15. Seiler, M.C., Seiler, F.A., et al.: Numerical recipes in c: the art of scientific computing. Risk Anal. 9(3), 415–416 (1989)

    Article  Google Scholar 

  16. Sun, H., Xu, J., Zheng, K., Zhao, P., Chao, P., Zhou, X.: MFNP: a meta-optimized model for few-shot next POI recommendation. In: IJCAI, pp. 3017–3023 (2021)

    Google Scholar 

  17. Vaswani, A., et al.: Attention is all you need. In: NIPS, pp. 5998–6008 (2017)

    Google Scholar 

  18. Xiao, S., Yan, J., Yang, X., Zha, H., Chu, S.M.: Modeling the intensity function of point process via recurrent neural networks. In: AAAI, pp. 1597–1603 (2017)

    Google Scholar 

  19. Xu, J., Zhao, J., Zhou, R., Liu, C., Zhao, P., Zhao, L.: Predicting destinations by a deep learning based approach. TKDE 33(2), 651–666 (2021)

    Google Scholar 

  20. Xu, S., Zhang, R., Cheng, W., Xu, J.: MTLM: a multi-task learning model for travel time estimation. GeoInformatica (1) (2020)

    Google Scholar 

  21. Xue, A.Y., Zhang, R., Zheng, Y., Xie, X., Huang, J., Xu, Z.: Destination prediction by sub-trajectory synthesis and privacy protection against such prediction. In: ICDE, pp. 254–265 (2013)

    Google Scholar 

  22. Yang, D., Fankhauser, B., Rosso, P., Cudré-Mauroux, P.: Location prediction over sparse user mobility traces using RNNs: flashback in hidden states! In: IJCAI, pp. 2184–2190 (2020)

    Google Scholar 

  23. Yang, G., Cai, Y., Reddy, C.K.: Recurrent spatio-temporal point process for check-in time prediction. In: CIKM, pp. 2203–2211 (2018)

    Google Scholar 

  24. Yang, G., Cai, Y., Reddy, C.K.: Spatio-temporal check-in time prediction with recurrent neural network based survival analysis. In: IJCAI, pp. 2976–2983 (2018)

    Google Scholar 

  25. Zhang, Y., Yang, Q.: A survey on multi-task learning. CoRR abs/1707.08114 (2017)

    Google Scholar 

  26. Zhao, J., Xu, J., Zhou, R., Zhao, P., Liu, C., Zhu, F.: On prediction of user destination by sub-trajectory understanding: A deep learning based approach. In: CIKM, pp. 1413–1422. ACM (2018)

    Google Scholar 

Download references

Acknowledgement

This work was supported by National Natural Science Foundation of China projects under grant numbers (No.61872258, No.61772356, No.62072125), the major project of natural science research in universities of Jiangsu province under grant number 20KJA520005, the priority academic program development of Jiangsu higher education institutions, young scholar program of Cyrus Tang Foundation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jiajie Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xu, Y., Xu, J., Fang, J., Liu, A., Zhao, L. (2022). When Multitask Learning Make a Difference: Spatio-Temporal Joint Prediction for Cellular Trajectories. In: Bhattacharya, A., et al. Database Systems for Advanced Applications. DASFAA 2022. Lecture Notes in Computer Science, vol 13245. Springer, Cham. https://doi.org/10.1007/978-3-031-00123-9_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-00123-9_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-00122-2

  • Online ISBN: 978-3-031-00123-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics