Ghazal Alinezhad Noghre
ABSTRACT
Pishgu is a universal lightweight network architecture for path prediction in Cyber-Physical Systems (CPS) applications, adaptable to multiple subjects, perspectives, and scenes. Our proposed architecture captures inter-dependencies within the subjects in each frame using Graph Isomorphism Networks and attention. In our demonstration, we will show how Pishgu can predict trajectories for pedestrians and vehicles in different real-world scenarios. We will use video data from various sources, such as surveillance cameras, drones, etc., to illustrate the diversity of subjects, perspectives, and scenes that Pishgu can handle. The goal of our demonstration is to showcase the adaptability and robustness of Pishgu in various CPS applications. We will highlight how Pishgu can capture inter-dependencies within the subjects in each frame using Graph Isomorphism Networks (GINs) and attention mechanisms. We will also compare Pishgu with existing solutions on different metrics such as ADE and FDE. We hope that our demonstration will inspire attendees to explore new possibilities for path prediction in CPS applications using Pishgu. In addition, The demonstration will also consist of a poster to highlight the main features of Pishgu and the improvements achieved over the recent trajectory prediction methods.
- TRECVID Awad George. 2018. Benchmarking Video Activity Detection, Video Captioning and Matching, Video Storytelling Linking and Video Search. In Proceedings of TRECVID.Google Scholar
- James Colyar and John Halkias. 2006. Next Generation SIMulation (NGSIM), Interstate 80 Freeway Dataset. FHWA-HRT-06-137. https://www.fhwa.dot.gov/publications/research/operations/06137/Google Scholar
- James Colyar and John Halkias. 2007. Next Generation SIMulation (NGSIM), US Highway-101 dataset. FHWA-HRT-07-030. https://www.fhwa.dot.gov/publications/research/operations/07030/Google Scholar
- Vinit Katariya, Mohammadreza Baharani, Nichole Morris, Omidreza Shoghli, and Hamed Tabkhi. 2022. DeepTrack: Lightweight Deep Learning for Vehicle Trajectory Prediction in Highways. IEEE Transactions on Intelligent Transportation Systems (2022), 1--10. Google ScholarCross Ref
- Alon Lerner, Yiorgos Chrysanthou, and Dani Lischinski. 2007. Crowds by example. In Computer graphics forum, Vol. 26. Wiley Online Library, 655--664.Google Scholar
- Lihuan Li, Maurice Pagnucco, and Yang Song. 2022. Graph-Based Spatial Transformer With Memory Replay for Multi-Future Pedestrian Trajectory Prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2231--2241.Google ScholarCross Ref
- Xin Li, Xiaowen Ying, and Mooi Choo Chuah. 2020. GRIP ++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Driving. arXiv preprint arXiv:1907.07792 (2020).Google Scholar
- Junwei Liang, Lu Jiang, and Alexander Hauptmann. 2020. Simaug: Learning robust representations from simulation for trajectory prediction. In European Conference on Computer Vision. Springer, 275--292.Google ScholarDigital Library
- Junwei Liang, Lu Jiang, Kevin Murphy, Ting Yu, and Alexander Hauptmann. 2020. The garden of forking paths: Towards multi-future trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10508--10518.Google ScholarCross Ref
- Junwei Liang, Lu Jiang, Juan Carlos Niebles, Alexander G Hauptmann, and Li Fei-Fei. 2019. Peeking into the future: Predicting future person activities and locations in videos. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 5725--5734.Google Scholar
- Lei Lin, Weizi Li, Huikun Bi, and Lingqiao Qin. 2022. Vehicle Trajectory Prediction Using LSTMs With Spatial-Temporal Attention Mechanisms. IEEE Intell. Transp. Syst. Mag. 14, 2 (2022), 197--208. Google ScholarCross Ref
- Stefano Pellegrini, Andreas Ess, Konrad Schindler, and Luc Van Gool. 2009. You'll never walk alone: Modeling social behavior for multi-target tracking. In 2009 IEEE 12th international conference on computer vision. IEEE, 261--268.Google ScholarCross Ref
- Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826 (2018).Google Scholar
Recommendations
Pishgu: Universal Path Prediction Network Architecture for Real-time Cyber-physical Edge Systems
ICCPS '23: Proceedings of the ACM/IEEE 14th International Conference on Cyber-Physical Systems (with CPS-IoT Week 2023)Path prediction is an essential task for many real-world Cyber-Physical Systems (CPS) applications, from autonomous driving and traffic monitoring/management to pedestrian/worker safety. These real-world CPS applications need a robust, lightweight ...
Modeling Automotive Cyber Physical Systems
DCABES '13: Proceedings of the 2013 12th International Symposium on Distributed Computing and Applications to Business, Engineering & ScienceAutomotive cyber physical systems (CPSs) involve interactions between software controllers, communication networks, and physical devices. These systems are among the most complex cyber physical systems being designed by humans. However, automotive cyber ...
Comments