Skip to main content

Multiple Pedestrian Tracking Based on Multi-layer Graph with Tracklet Segmentation and Merging

  • Conference paper
  • First Online:
Biometric Recognition (CCBR 2016)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9967))

Included in the following conference series:

  • 2789 Accesses

Abstract

Multiple pedestrian tracking is regarded as a challenging work due to difficulties of occlusion, abrupt motion and changes in appearance. In this paper, we propose a multi-layer graph based data association framework to address occlusion problem. Our framework is hierarchical with three association layers and each layer has its corresponding association method. We generate short tracklets and segment some of them into small pieces based on the segmentation condition in the first layer. The segmented tracklets are merged into long tracklets using spatial-temporal information in the second layer. In the last layer, tracklets in neighboring frame-window are merged to form object track mainly by searching the global maximum overlap ratio of the tracklets. Since appearance information is not available in various scenarios, we don’t use any appearance features in our work. We evaluate our algorithm on extensive sequences including two categories and demonstrate superior experimental results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/ShiqiYu/libfacedetection.

References

  1. Nagai, Y., Kamisaka, D., Makibuchi, N., Xu, J., Sakazawa, S.: 3D person tracking in world coordinates and attribute estimation with PDR. In: Proceedings of the 23rd ACM International Conference on Multimedia, MM 2015, pp. 1139–1142. ACM, New York (2015)

    Google Scholar 

  2. Tsokas, N.A., Kyriakopoulos, K.J.: Multi-robot multiple hypothesis tracking for pedestrian tracking. Auton. Robots 32(1), 63–79 (2012)

    Article  Google Scholar 

  3. Kasuya, N., Kitahara, I., Kameda, Y., Ohta, Y.: Real-time soccer player tracking method by utilizing shadow regions. In: Proceedings of the 18th ACM International Conference on Multimedia, MM 2010, pp. 1319–1322. ACM, New York (2010)

    Google Scholar 

  4. Chu, C.-T., Hwang, J.-N., Pai, H.-I., Lan, K.-M.: Tracking human under occlusion based on adaptive multiple kernels with projected gradients. IEEE Trans. Multimedia 15(7), 1602–1615 (2013)

    Article  Google Scholar 

  5. Wang, Z., Yoon, S., Park, D.S.: Online adaptive multiple pedestrian tracking in monocular surveillance video. Neural Comput. Appl. 1–15 (2016)

    Google Scholar 

  6. Kim, D., Kim, D.: Self-occlusion handling for human body motion tracking from 3D TOF image sequence. In: Proceedings of the 1st International Workshop on 3D Video Processing, 3DVP 2010, pp. 57–62. ACM, New York (2010)

    Google Scholar 

  7. Wen, L., Li, W., Yan, J., Lei, Z., Yi, D., Li, S.Z.: Multiple target tracking based on undirected hierarchical relation hypergraph. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1282–1289. IEEE (2014)

    Google Scholar 

  8. Shu, G., Dehghan, A., Oreifej, O., Hand, E., Shah, M.: Part-based multiple-person tracking with partial occlusion handling. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1815–1821. IEEE (2012)

    Google Scholar 

  9. Amitha Perera, A.G., Srinivas, C., Hoogs, A., Brooksby, G., Hu, W.: Multi-object tracking through simultaneous long occlusions and split-merge conditions. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 666–673. IEEE (2006)

    Google Scholar 

  10. Tang, S., Andriluka, M., Schiele, B.: Detection and tracking of occluded people. Int. J. Comput. Vis. 110(1), 58–69 (2014)

    Article  Google Scholar 

  11. Possegger, H., Mauthner, T., Roth, P., Bischof, H.: Occlusion geodesics for online multi-object tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1306–1313 (2014)

    Google Scholar 

  12. Lee, D.-Y., Sim, J.-Y., Kim, C.-S.: Multihypothesis trajectory analysis for robust visual tracking. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015

    Google Scholar 

  13. Lu, Y., Wu, T., Zhu, S.: Online object tracking, learning and parsing with and-or graphs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3462–3469 (2014)

    Google Scholar 

  14. Li, Y., Zhu, J., Hoi, S.C.H.: Reliable patch trackers: robust visualtracking by exploiting reliable patches. In: The IEEE Conference on ComputerVision and Pattern Recognition (CVPR), June 2015

    Google Scholar 

  15. Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D., Tao, D.: Multi-store tracker (muster): a cognitive psychology inspired approach toobject tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 749–758 (2015)

    Google Scholar 

  16. Vadivel, K.S., Ngo, T., Eckstein, M., Manjunath, B.S.: Eye tracking assisted extraction of attentionally important objects from videos. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015

    Google Scholar 

  17. Tang, S., Andres, B., Andriluka, M., Schiele, B.: Subgraph decomposition for multi-target tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5033–5041 (2015)

    Google Scholar 

  18. Chari, V., Lacoste-Julien, S., Laptev, I., Sivic, J.: On pairwise costs for network flow multi-object tracking. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015

    Google Scholar 

  19. Kuhn, H.W.: The hungarian method for the assignment problem. Navalresearch Logistics Q. 2(1–2), 83–97 (1955)

    Article  MathSciNet  MATH  Google Scholar 

  20. Hofmann, M., Tiefenbacher, P., Rigoll, G.: Background segmentation with feedback: the pixel-based adaptivesegmenter. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 38–43. IEEE (2012)

    Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (No. 61672429, No. 61502364, No. 61272288, No. 61231016), ShenZhen Science and Technology Foundation (JCYJ20160229172932237), Northwestern Polytechnical University (NPU) New AoXiang Star (No. G2015KY0301), Fundamental Research Funds for the Central Universities (No. 3102015AX007), NPU New People and Direction (No. 13GH014604).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tao Yang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Duan, W., Yang, T., Li, J., Zhang, Y. (2016). Multiple Pedestrian Tracking Based on Multi-layer Graph with Tracklet Segmentation and Merging. In: You, Z., et al. Biometric Recognition. CCBR 2016. Lecture Notes in Computer Science(), vol 9967. Springer, Cham. https://doi.org/10.1007/978-3-319-46654-5_80

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46654-5_80

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46653-8

  • Online ISBN: 978-3-319-46654-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics