Abstract
We present a human-head-orientation estimation approach which enables effective estimation of head orientations of multiple individuals appeared within the same scene. Our approach bases deep representation in order to obtain adequate visual features of head orientations. To boost the estimation performance, we propose a conditional random field which fuses shallow feature, deep feature and spatial-temporal contextual cues, where the fusing parameters are learned from data via structured support vector machine. We demonstrate that the three components of fusion are complementary to each other in terms of head orientation estimation. Meanwhile, the proposed spatial-temporal field outperforms the state-of-the-art significantly on public dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, Z., Shi, Q., Shen, C., Hengel, A.: Bilinear programming for human activity recognition with unknown MRF graphs. In: Computer Vision and Pattern Recognition (2013)
Tran, D.T., Lee, J.-H.: A robust method for head orientation estimation using histogram of oriented gradients. In: Kim, T., Adeli, H., Ramos, C., Kang, B.-H. (eds.) SIP 2011. CCIS, vol. 260, pp. 391–400. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-27183-0_41
Foytik, J., Asari, V.K.: A two-layer framework for piecewise linear manifold-based head pose estimation. Int. J. Comput. Vis. 101(2), 270–287 (2013)
Lee, D., Yang, M.H., Oh, S.: Fast and accurate head pose estimation via random projection forests. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1958–1966 (2015)
Lu, J., Tan, Y.P.: Ordinary preserving manifold analysis for human age and head pose estimation. IEEE Trans. Hum.-Mach. Syst. 43(2), 249–258 (2013)
Breitenstein, M.D., Kuettel, D., Weise, T., Van Gool, L., Pfister, H.: Real-time face pose estimation from single range images. In: Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Li, S., Chan, A.B.: 3D human pose estimation from monocular images with deep convolutional neural network. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9004, pp. 332–347. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16808-1_23
Li, S., Ngan, K.N., Paramesran, R., Sheng, L.: Real-time head pose tracking with online face template reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 38(9), 1922–1928 (2016)
Patron-Perez, A., Marszalek, M., Reid, I., Zisserman, A.: TV Human Interaction Dataset. http://www.robots.ox.ac.uk/~alonso/tv_human_interactions.html
Patron-Perez, A., Marszalek, M., Reid, I., Zisserman, A.: Structured learning of human interactions in TV shows. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2441–2453 (2012)
Ahn, B., Park, J., Kweon, I.S.: Real-time head orientation from a monocular camera using deep neural network. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9005, pp. 82–96. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16811-1_6
Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: LIBLINEAR: a library for large linear classification. J. Mach. Learn. Res. 9, 1871–1874 (2008)
Kang, M.J., Lee, J.K., Kang, J.W.: Combining random forest with multi-block local binary pattern feature selection for multiclass head pose estimation. Plos One 12(7), e0180792 (2017)
Joseph, R., Santosh, D., Ross, G., Ali, F.: You only look once: unified, real-time object detection. In: Computer Vision & Pattern Recognition (2016)
Ioannis, T., Thorsten, J., Thomas, H., Yasemin, A.: Large margin methods for structured and interdependent output variables. J. Mach. Learn. Res. 6(2), 1453–1484 (2006)
Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: LIBLINEAR: a library for large linear classification. J. Mach. Learn. Res. 9(9), 1871–1874 (2008)
Yao, R., Xia, S., Zhang, Z., Zhang, Y.: Real-time correlation filter tracking by efficient dense belief propagation with structure preserving. IEEE Trans. Multimedia 19(4), 772–784 (2017)
Yao, R., Lin, G., Shen, C., Zhang, Y., Shi, Q.: Semantics-aware visual object tracking. IEEE Trans. Circ. Syst. Video Technol. 29, 1687–1700 (2018)
Yao, R., Xia, S., Shen, F., Zhou, Y., Niu, Q.: Exploiting spatial structure from parts for adaptive kernelized correlation filter tracker. IEEE Sig. Process. Lett. 23(5), 658–662 (2016)
Acknowledgement
This work is partially supported by National Natural Science Foundation of China (61802348, 61876167) and National Key R&D Program of China (2018YFB1305200).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Xiong, Z., Wang, Z., Wang, Z., Zhang, J. (2019). Deep Spatial-Temporal Field for Human Head Orientation Estimation. In: Gedeon, T., Wong, K., Lee, M. (eds) Neural Information Processing. ICONIP 2019. Lecture Notes in Computer Science(), vol 11955. Springer, Cham. https://doi.org/10.1007/978-3-030-36718-3_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-36718-3_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36717-6
Online ISBN: 978-3-030-36718-3
eBook Packages: Computer ScienceComputer Science (R0)