Abstract
Modeling pedestrian interaction is an essential building block in pedestrian trajectory prediction, which raises various challenges such as the complexity of social behavior and the randomness of motion. In this paper, a new relevant entropy spatio-temporal graph convolutional network is proposed to model pedestrian interaction for pedestrian trajectory prediction, which contains regional spatiotemporal graph convolutional neural network and gated dilation causal convolutional neural network. The regional spatio-temporal graph convolutional neural network creates a matching graph structure for each time step, and calculates the weighted adjacency matrix of each graph structure through relevant entropy to obtain the sequence embedding representation of the pedestrian interaction relationship. The gated dilation causal convolutional neural network reduces the linear superposition of the hidden layer through the setting of the dilated factor, and uses the gating mechanism to filter the features. Experiments are carried out on the standard data sets ETH and UCY, higher accuracy and efficiency verify that the proposed method is effective in pedestrian interaction modeling.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Zhao, H., Wildes, R.P.: Where are you heading? Dynamic trajectory prediction with expert goal examples. In: Proceedings of the International Conference on Computer Vision, pp. 7629–7638 (2021)
Peng, Y., Zhang, G., Li, X., Zheng, L.: STIRNet: a spatial-temporal interaction-aware recursive network for human trajectory prediction. In: Proceedings of the International Conference on Computer Vision, pp. 2285–2293 (2021)
Cai, Y., et al.: Pedestrian motion trajectory prediction in intelligent driving from far shot first-person perspective video. IEEE Trans. Intell. Transp. Syst. (2021, in press). https://ieeexplore.ieee.org/document/9340008
Quan, R., Zhu, L., Wu, Y., Yang, Y.: Holistic LSTM for pedestrian trajectory prediction. IEEE Trans. Image Process. 30, 3229–3239 (2021)
Li, Y., Liang, R., Wei, W., Wang, W., Zhou, J., Li, X.: Temporal pyramid network with spatial-temporal attention for pedestrian trajectory prediction. IEEE Trans. Netw. Sci. Eng. (2021, in press). https://ieeexplore.ieee.org/document/9373939
Cai, Y., et al.: Environment-attention network for vehicle trajectory prediction. IEEE Trans. Veh. Technol. 70, 11216–11227 (2021)
Pang, B., Zhao, T., Xie, X., Wu, Y.N.: Trajectory prediction with latent belief energy-based model. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 11814–11824 (2021)
Zhang, B., Yuan, C., Wang, T., Liu, H.: STENet: a hybrid spatio-temporal embedding network for human trajectory forecasting. Eng. Appl. Artif. Intell. 106, 104487 (2021)
Chen, G., Li, J., Lu, J., Zhou J.: Human trajectory prediction via counterfactual analysis. In Proceedings of the International Conference on Computer Vision, pp. 9824–9833 (2021)
Zhang, B., Zhang, R., Bisagno, N., Conci, N., De Natale, F.G.B., Liu, H.: Where are they going? Predicting human behaviors in crowded scenes. ACM Trans. Multimedia Comput. 17, 1–19 (2021)
Zhang, B., Wang, N., Zhao, Z., Abraham, A., Liu, H.: Crowd counting based on attention-guided multi-scale fusion networks. Neurocomputing 451, 12–24 (2021)
Zernetsch, S., Kohnen, S., Goldhammer, M., Doll, K., Sick, B.: Trajectory prediction of cyclists using a physical model and an artificial neural network. In: 2016 IEEE Intelligent Vehicles Symposium, pp. 833–838. IEEE (2016)
Kooij, J.F.P., Flohr, F., Pool, E.A.I., Gavrila, D.M.: Context-based path prediction for targets with switching dynamics. Int. J. Comput. Vis. 127(3), 239–262 (2019). https://doi.org/10.1007/s11263-018-1104-4
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., Savarese, S.: Social LSTM: human trajectory prediction in crowded spaces. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 961–971 (2016)
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., Alahi, A.: Social GAN: socially acceptable trajectories with generative adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2255–2264 (2018)
Mohamed, A., Qian, K., Elhoseiny, M., Claudel, C.: Social-STGCNN: a social spatio-temporal graph convolutional neural network for human trajectory prediction. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 14424–14432 (2020)
Shen, M., Habibi, G., How, J.P.: Transferable pedestrian motion prediction models at intersections. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4547–4553, IEEE (2018)
Ho, J., Ermon, S.: Generative adversarial imitation learning. Adv. Neural Inf. Process. Syst. 29, 4565–4573 (2016)
Rhinehart, N., Kitani, K.M., Vernaza, P.: R2P2: a reparameterized pushforward policy for diverse, precise generative path forecasting. In: Proceedings of the European Conference on Computer Vision, pp. 772–788 (2018)
Xie, G., Shangguan, A., Fei, R., Ji, W., Ma, W., Hei, X.: Motion trajectory prediction based on a CNN-LSTM sequential model. Sci. China Inf. Sci. 63(11), 212207 (2020). https://doi.org/10.1007/s11432-019-2761-y
Zhao, D., Jean, O.: Noticing motion patterns: a temporal CNN with a novel convolution operator for human trajectory prediction. IEEE Robot. Autom. Lett. 6(2), 628–634 (2020)
Sadeghian, A., Kosaraju, V., Sadeghian, A., Hirose, N., Rezatofighi, H., Savarese, S.: SoPhie: an attentive GAN for predicting paths compliant to social and physical constraints. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1349–1358 (2019)
Acknowledgements
This work is supported in part by the National Natural Science Foundation of China (Grant Nos. 61772102, 62176036) and the Liaoning Collaborative Fund (Grant No. 2020-HYLH-17).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, N., Wang, Y., Zhou, C., Abraham, A., Liu, H. (2022). REGION: Relevant Entropy Graph spatIO-temporal convolutional Network for Pedestrian Trajectory Prediction. In: Abraham, A., et al. Innovations in Bio-Inspired Computing and Applications. IBICA 2021. Lecture Notes in Networks and Systems, vol 419. Springer, Cham. https://doi.org/10.1007/978-3-030-96299-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-96299-9_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-96298-2
Online ISBN: 978-3-030-96299-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)