skip to main content
10.1145/3664647.3681340acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Traj2Former: A Local Context-aware Snapshot and Sequential Dual Fusion Transformer for Trajectory Classification

Published: 28 October 2024 Publication History

Abstract

The wide use of mobile devices has led to a proliferated creation of extensive trajectory data, rendering trajectory classification increasingly vital and challenging for downstream applications. Existing deep learning methods offer powerful feature extraction capabilities to detect nuanced variances in trajectory classification tasks. However, their effectiveness remains compromised by the following two unsolved challenges. First, identifying the distribution of nearby trajectories based on noisy and sparse GPS coordinates poses a significant challenge, providing critical contextual features to the classification. Second, though efforts have been made to incorporate a shape feature by rendering trajectories into images, they fail to model the local correspondence between GPS points and image pixels. To address these issues, we propose a novel model termed Traj2Former to spotlight the spatial distribution of the adjacent trajectory points (i.e., contextual snapshot) and enhance the snapshot fusion between the trajectory data and the corresponding spatial contexts. We propose a new GPS rendering method to generate contextual snapshots, but it can be applied from a trajectory database to a digital map. Moreover, to capture diverse temporal patterns, we conduct a multi-scale sequential fusion by compressing the trajectory data with differing rates. Extensive experiments have been conducted to verify the superiority of the Traj2Former model.

Supplemental Material

MP4 File - <10.1145/3664647.3681340#>.video
The video of "Traj2Former: A Local Context-aware Snapshot and Sequential Dual Fusion Transformer for Trajectory Classification".

References

[1]
Jiang Bian, Dayong Tian, Yuanyan Tang, and Dacheng Tao. 2019. Trajectory Data Classification: A Review. ACM Trans. Intell. Syst. Technol., Vol. 10, 4, Article 33 (2019), 34 pages.
[2]
Meng-Jiun Chiou, Zhenguang Liu, Yifang Yin, An-An Liu, and Roger Zimmermann. 2020. Zero-Shot Multi-View Indoor Localization via Graph Location Networks. In ACM Multimedia. 3431--3440. https://doi.org/10.1145/3394171.3413856
[3]
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder--Decoder for Statistical Machine Translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1724--1734.
[4]
Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine learning, Vol. 20 (1995), 273--297.
[5]
Sina Dabiri and Kevin Heaslip. 2018. Inferring transportation modes from GPS trajectories using a convolutional neural network. Transportation research part C: emerging technologies, Vol. 86 (2018), 360--371.
[6]
Sina Dabiri, Chang-Tien Lu, Kevin Heaslip, and Chandan K. Reddy. 2020. Semi-Supervised Deep Learning Approach for Transportation Mode Identification Using GPS Trajectory Data. IEEE Transactions on Knowledge and Data Engineering, Vol. 32, 5 (2020), 1010--1023. https://doi.org/10.1109/TKDE.2019.2896985
[7]
Hongda Duan, Fei Ma, Lixin Miao, and Canrong Zhang. 2022. A semi-supervised deep learning approach for vessel trajectory classification based on AIS data. Ocean & Coastal Management, Vol. 218 (2022), 106015.
[8]
Yuki Endo, Hiroyuki Toda, Kyosuke Nishida, and Akihisa Kawanobe. 2016. Deep feature extraction from trajectories for transportation mode estimation. In Advances in Knowledge Discovery and Data Mining: 20th Pacific-Asia Conference, PAKDD 2016. Springer, 54--66.
[9]
Qiang Gao, Fan Zhou, Kunpeng Zhang, Goce Trajcevski, Xucheng Luo, and Fengli Zhang. 2017. Identifying Human Mobility via Trajectory Embeddings. In IJCAI, Vol. 17. 1689--1695.
[10]
Pall Oskar Gislason, Jon Atli Benediktsson, and Johannes R Sveinsson. 2006. Random forests for land cover classification. Pattern recognition letters, Vol. 27, 4 (2006), 294--300.
[11]
Ralf Hartmut Güting, Thomas Behr, and Jianqiu Xu. 2010. Efficient k-nearest neighbor search on moving object trajectories. The VLDB Journal, Vol. 19 (2010), 687--714.
[12]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.
[13]
Danlei Hu, Ziquan Fang, Hanxi Fang, Tianyi Li, Chunhui Shen, Lu Chen, and Yunjun Gao. 2022. Estimator: An Effective and Scalable Framework for Transportation Mode Classification over Trajectories. CoRR, Vol. abs/2212.05502 (2022).
[14]
Ioannis Kontopoulos, Antonios Makris, Konstantinos Tserpes, and Vania Bogorny. 2022. TraClets: Harnessing the power of computer vision for trajectory classification. arXiv preprint arXiv:2205.13880 (2022).
[15]
Ioannis Kontopoulos, Antonios Makris, Dimitris Zissis, and Konstantinos Tserpes. 2021. A computer vision approach for trajectory classification. In 22nd IEEE International Conference on Mobile Data Management, MDM 2021, Toronto, ON, Canada, June 15--18, 2021. IEEE, 163--168.
[16]
Shiyong Lan, Yitong Ma, Weikang Huang, Wenwu Wang, Hongyu Yang, and Pyang Li. 2022. Dstagnn: Dynamic spatial-temporal aware graph neural network for traffic flow forecasting. In International conference on machine learning. PMLR, 11906--11917.
[17]
Cristiano Landi, Riccardo Guidotti, Mirco Nanni, and Anna Monreale. 2023. The Trajectory Interval Forest Classifier for Trajectory Classification. In Proceedings of the 31st ACM International Conference on Advances in Geographic Information Systems (SIGSPATIAL '23). Article 67, 4 pages.
[18]
Jae-Gil Lee, Jiawei Han, Xiaolei Li, and Hector Gonzalez. 2008. TraClass: Trajectory Classification Using Hierarchical Region-Based and Trajectory-Based Clustering. Proc. VLDB Endow., Vol. 1, 1 (2008), 1081--1094.
[19]
Yuxuan Liang, Kun Ouyang, Yiwei Wang, Xu Liu, Hongyang Chen, Junbo Zhang, Yu Zheng, and Roger Zimmermann. 2022. TrajFormer: Efficient Trajectory Classification with Transformers. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 1229--1237.
[20]
Yuxuan Liang, Kun Ouyang, Hanshu Yan, Yiwei Wang, Zekun Tong, and Roger Zimmermann. 2021. Modeling Trajectories with Neural Ordinary Differential Equations. In IJCAI. 1498--1504.
[21]
Christos Markos, JQ James, and Richard Yi Da Xu. 2021. Capturing uncertainty in unsupervised GPS trajectory segmentation using Bayesian deep learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 390--398.
[22]
Sijie Ruan, Cheng Long, Jie Bao, Chunyang Li, Zisheng Yu, Ruiyuan Li, Yuxuan Liang, Tianfu He, and Yu Zheng. 2020. Learning to generate maps from trajectories. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 890--897.
[23]
M. Schuster and K.K. Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, Vol. 45, 11 (1997), 2673--2681.
[24]
Pengxiang Su, Zhenguang Liu, Shuang Wu, Lei Zhu, Yifang Yin, and Xuanjing Shen. 2021. Motion Prediction via Joint Dependency Modeling in Phase Space. In ACM Multimedia. 713--721. https://doi.org/10.1145/3474085.3475237
[25]
Heli Sun, Xianglan Guo, Zhou Yang, Xuguang Chu, Xinwang Liu, and Liang He. 2022. Predicting Future Locations with Semantic Trajectories. ACM Trans. Intell. Syst. Technol., Vol. 13, 1 (2022), 20 pages.
[26]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, Vol. 30 (2017).
[27]
Hao Wu, Ziyang Chen, Weiwei Sun, Baihua Zheng, and Wei Wang. 2017. Modeling trajectories with recurrent neural networks. In Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia, August 19, Vol. 25. 3083--3090.
[28]
Yuan Xie, Yongheng Wang, Kenli Li, Xu Zhou, Zhao Liu, and Keqin Li. 2023. Satisfaction-aware task assignment in spatial crowdsourcing. Information Sciences, Vol. 622 (2023), 512--535.
[29]
Yuan Xie, Fan Wu, Xu Zhou, Wensheng Luo, Yifang Yin, Roger Zimmermann, Keqin Li, and Kenli Li. 2023. Trajectory-aware Task Coalition Assignment in Spatial Crowdsourcing. IEEE Transactions on Knowledge and Data Engineering (2023). https://doi.org/10.1109/TKDE.2023.3336642
[30]
Yuan Xie, Fan Wu, Xu Zhou, Wensheng Luo, Yifang Yin, Roger Zimmermann, Keqin Li, and Kenli Li. 2024. Trajectory-aware Task Coalition Assignment in Spatial Crowdsourcing (Extended Abstract). IEEE International Conference on Data Engineering (ICDE) (2024).
[31]
Yifang Yin, Wenmiao Hu, An Tran, Ying Zhang, Guanfeng Wang, Hannes Kruppa, Roger Zimmermann, and See-Kiong Ng. 2023. Multimodal deep learning for robust road attribute detection. ACM Transactions on Spatial Algorithms and Systems, Vol. 9, 4 (2023), 1--25.
[32]
Yifang Yin, An Tran, Ying Zhang, Wenmiao Hu, Guanfeng Wang, Jagannadan Varadarajan, Roger Zimmermann, and See-Kiong Ng. 2021. Multimodal Fusion of Satellite Images and Crowdsourced GPS Traces for Robust Road Attribute Detection. In Proceedings of the 29th International Conference on Advances in Geographic Information Systems. 107--116.
[33]
Yifang Yin, Jagannadan Varadarajan, Guanfeng Wang, Xueou Wang, Dhruva Sahrawat, Roger Zimmermann, and See-Kiong Ng. 2020. A multi-task learning framework for road attribute updating via joint analysis of map data and GPS traces. In Proceedings of The Web Conference 2020. 2662--2668.
[34]
Yu Zheng. 2015. Trajectory Data Mining: An Overview. ACM Trans. Intell. Syst. Technol., Vol. 6, 3 (2015).
[35]
Yu Zheng, Quannan Li, Yukun Chen, Xing Xie, and Wei-Ying Ma. 2008. Understanding Mobility Based on GPS Data (UbiComp '08). 312--321.
[36]
Yu Zheng, Like Liu, Longhao Wang, and Xing Xie. 2008. Learning Transportation Mode from Raw Gps Data for Geographic Applications on the Web. In Proceedings of the 17th International Conference on World Wide Web (WWW '08). New York, NY, USA, 247--256. https://doi.org/10.1145/1367497.1367532
[37]
Yu Zhu, Hao Li, Yikang Liao, Beidou Wang, Ziyu Guan, Haifeng Liu, and Deng Cai. 2017. What to Do Next: Modeling User Behaviors by Time-LSTM. In IJCAI, Vol. 17. 3602--3608.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '24: Proceedings of the 32nd ACM International Conference on Multimedia
October 2024
11719 pages
ISBN:9798400706868
DOI:10.1145/3664647
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. mapped trajectory.
  2. trajectory classification
  3. transformer

Qualifiers

  • Research-article

Funding Sources

  • Programs of Hunan Province
  • Program of NSFC
  • Singapore Ministry of Education Academic Research Fund Tier 2

Conference

MM '24
Sponsor:
MM '24: The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne VIC, Australia

Acceptance Rates

MM '24 Paper Acceptance Rate 1,150 of 4,385 submissions, 26%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 92
    Total Downloads
  • Downloads (Last 12 months)92
  • Downloads (Last 6 weeks)17
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media