Abstract
Spatio-temporal joint prediction aims to simultaneously predict the next location and the corresponding switch time for a cellular trajectory. It requires to consider not only the mutual influence of spatio-temporal predicting tasks, but also the signals related to the intentions of the travel. Although multitask learning can support the joint prediction by considering both spatio-temporal signals, existing approaches neglect the effects of travel intentions and fail to model the long-term dependencies in trajectory, resulting in sub-optimal results accordingly. To solve these issues, we propose an intention-aware multitask learning method for spatio-temporal joint prediction, such that predicting travel intention is learned as an auxiliary task. Specifically, due to the implicity of travel intention, we design an effective loss function to learn meaningful intention representation, which can capture trajectory’s future moving goal, so as to provide long-term information for spatio-temporal joint prediction. Furthermore, we carefully design a gating mechanism to fuse sequential and intentional information with different weights to reflect their importance in capturing current movement status. Besides, self-attention network is adopted to model the long-term dependencies of far sampling points in a dense trajectory. Finally, extensive experiments on two trajectory datasets demonstrate the superiority of our method.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aalen, O., Borgan, O., Gjessing, H.: Survival and Event History Analysis: A Process Point of View. Springer, New York (2008). https://doi.org/10.1007/978-0-387-68560-1
Ba, L.J., Kiros, J.R., Hinton, G.E.: Layer normalization. CoRR abs/1607.06450 (2016)
Blondel, V.D., Decuyper, A., Krings, G.: A survey of results on mobile phone datasets analysis. EPJ Data Sci. 4(1), 1–55 (2015). https://doi.org/10.1140/epjds/s13688-015-0046-0
Du, N., Dai, H., Trivedi, R., Upadhyay, U., Gomez-Rodriguez, M., Song, L.: Recurrent marked temporal point processes: embedding event history to vector. In: SIGKDD, pp. 1555–1564 (2016)
Feng, J., et al.: Deepmove: predicting human mobility with attentional recurrent networks. In: WWW, pp. 1459–1468 (2018)
Gu, Y.: Attentive neural point processes for event forecasting. In: AAAI, pp. 7592–7600 (2021)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR, pp. 770–778 (2016)
Kong, D., Wu, F.: HST-LSTM: a hierarchical spatial-temporal long-short term memory network for location prediction. In: IJCAI, pp. 2341–2347 (2018)
Liang, W., Zhang, W.: Learning social relations and spatiotemporal trajectories for next check-in inference. TNNLS (2020)
Liu, Q., Wu, S., Wang, L., Tan, T.: Predicting the next location: a recurrent model with spatial and temporal contexts. In: AAAI, pp. 194–200 (2016)
Luca, M., Barlacchi, G., Lepri, B., Pappalardo, L.: Deep learning for human mobility: a survey on data and models. CoRR abs/2012.02825 (2020)
Luong, M., Le, Q.V., Sutskever, I., Vinyals, O., Kaiser, L.: Multi-task sequence to sequence learning. In: ICLR (2016)
Lv, Z., Xu, J., Zhao, P., Liu, G., Zhao, L., Zhou, X.: Outlier trajectory detection: a trajectory analytics based approach. In: Candan, S., Chen, L., Pedersen, T.B., Chang, L., Hua, W. (eds.) DASFAA 2017. LNCS, vol. 10177, pp. 231–246. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-55753-3_15
Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized Markov chains for next-basket recommendation. In: WWW, pp. 811–820 (2010)
Seiler, M.C., Seiler, F.A., et al.: Numerical recipes in c: the art of scientific computing. Risk Anal. 9(3), 415–416 (1989)
Sun, H., Xu, J., Zheng, K., Zhao, P., Chao, P., Zhou, X.: MFNP: a meta-optimized model for few-shot next POI recommendation. In: IJCAI, pp. 3017–3023 (2021)
Vaswani, A., et al.: Attention is all you need. In: NIPS, pp. 5998–6008 (2017)
Xiao, S., Yan, J., Yang, X., Zha, H., Chu, S.M.: Modeling the intensity function of point process via recurrent neural networks. In: AAAI, pp. 1597–1603 (2017)
Xu, J., Zhao, J., Zhou, R., Liu, C., Zhao, P., Zhao, L.: Predicting destinations by a deep learning based approach. TKDE 33(2), 651–666 (2021)
Xu, S., Zhang, R., Cheng, W., Xu, J.: MTLM: a multi-task learning model for travel time estimation. GeoInformatica (1) (2020)
Xue, A.Y., Zhang, R., Zheng, Y., Xie, X., Huang, J., Xu, Z.: Destination prediction by sub-trajectory synthesis and privacy protection against such prediction. In: ICDE, pp. 254–265 (2013)
Yang, D., Fankhauser, B., Rosso, P., Cudré-Mauroux, P.: Location prediction over sparse user mobility traces using RNNs: flashback in hidden states! In: IJCAI, pp. 2184–2190 (2020)
Yang, G., Cai, Y., Reddy, C.K.: Recurrent spatio-temporal point process for check-in time prediction. In: CIKM, pp. 2203–2211 (2018)
Yang, G., Cai, Y., Reddy, C.K.: Spatio-temporal check-in time prediction with recurrent neural network based survival analysis. In: IJCAI, pp. 2976–2983 (2018)
Zhang, Y., Yang, Q.: A survey on multi-task learning. CoRR abs/1707.08114 (2017)
Zhao, J., Xu, J., Zhou, R., Zhao, P., Liu, C., Zhu, F.: On prediction of user destination by sub-trajectory understanding: A deep learning based approach. In: CIKM, pp. 1413–1422. ACM (2018)
Acknowledgement
This work was supported by National Natural Science Foundation of China projects under grant numbers (No.61872258, No.61772356, No.62072125), the major project of natural science research in universities of Jiangsu province under grant number 20KJA520005, the priority academic program development of Jiangsu higher education institutions, young scholar program of Cyrus Tang Foundation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Xu, Y., Xu, J., Fang, J., Liu, A., Zhao, L. (2022). When Multitask Learning Make a Difference: Spatio-Temporal Joint Prediction for Cellular Trajectories. In: Bhattacharya, A., et al. Database Systems for Advanced Applications. DASFAA 2022. Lecture Notes in Computer Science, vol 13245. Springer, Cham. https://doi.org/10.1007/978-3-031-00123-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-00123-9_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-00122-2
Online ISBN: 978-3-031-00123-9
eBook Packages: Computer ScienceComputer Science (R0)