Skip to main content
Log in

Person tracking and reidentification: Introducing Panoramic Appearance Map (PAM) for feature representation

Machine Vision and Applications Aims and scope Submit manuscript

Abstract

This paper develops a concept of Panoramic Appearance Map (PAM) for performing person reidentification in a multi-camera setup. Each person is tracked in multiple cameras and the position on the floor plan is determined using triangulation. Using the geometry of the cameras and the person location, a panoramic map centered at the person’s location is created with the horizontal axis representing the azimuth angle and vertical axis representing the height. Each pixel in the map image gets color information from the cameras which can observe it. The maps between different tracks are compared using a distance measure based on weighted SSD in order to select the best match. Temporalintegration by registering multiple maps over the tracking period improves the matching performance. Experimental results of matching persons between two camera sets show the effectiveness of the approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. Bird N.D., Masoud O., Papanikolopoulos N.P. and Isaacs A. (2005). Detection of loitering individuals in public transportation areas. IEEE Tran. Intell. Transportation Sys. 6(2): 167–177

    Article  Google Scholar 

  2. Cai Q. and Aggarwal J.K. (1999). Tracking human motion in structured environments using a distributed-camera system. IEEE Trans. Pattern Recogn. Mach. Intell. 21(11): 1241–1247

    Article  Google Scholar 

  3. Chang, T., Gong, S.: Tracking multiple people with a multi-camera system. In: Proceedings of IEEE ICCV Workshop on Multi-Object Tracking. Vancouver (2001)

  4. Espina M.V. and Velastin S.A. (2005). Intelligent distributed surveillance systems: A review. IEE Proceedings—Vision, Image and Signal Processing 152(2): 192–204

    Article  Google Scholar 

  5. Gandhi, T., Trivedi, M.M.: Panoramic Appearance Map (PAM) for multi-camera based person re-identification. In: Proceedings of IEEE International Conference on Advanced Video and Signal-Based Surveillance. Sydney (2006)

  6. Gandhi T. and Trivedi M.M. (2006). Reconfigurable omnidirectional camera array calibration with a linear moving object. Image Vis. Comput. 24(9): 935–948

    Article  Google Scholar 

  7. Hu W., Tan T., Wang L. and Maybank S. (2005). A survey on visual surveillance of object motion and behaviors. IEEE Trans. Syst. Man Cybern. Part C 34(3): 334–352

    Article  Google Scholar 

  8. Huang K.C. and Trivedi M.M. (2003). Video arrays for real-time tracking of persons, head and face in an intelligent room. Mach. Vis. Appl. 14(2): 103–111

    Google Scholar 

  9. Huang, K.S., Trivedi, M.M.: 3D shape context based gesture analysis integrated with tracking using omni video array. In: IEEE Workshop on Vision for Human-Computer Interaction (V4HCI). San Diego, CA (2005)

  10. Huang T. and Russell S. (1998). Object identification: A Bayesian analysis with application to traffic surveillance. Artif. Intell. 103(1–2): 1–17

    Google Scholar 

  11. Javed, O., Rasheed, Z., Shafique, K., Shah, M.: Tracking across multiple cameras with disjoint views. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1–6 (2003)

  12. Kettnaker, V., Zabih, R.: Bayesian multi-camera surveillance. In: IEEE Conference on: Computer Vision and Pattern Recognition II:253–259 (1999

  13. Kogut, G., Trivedi, M.M.: Maintaining the identity of multiple vehicles as they travel through a video network. In: Proceedings of IEEE International Conference on Intelligent Transportation Systems, pp. 29–34. Oakland, California (2001)

  14. Mittal A. and Davis L. (2003). M2 tracker: a multi-view approach to segmenting and tracking people in a cluttered scene. Int. J. Comput. Vis. 51(3): 189–203

    Article  Google Scholar 

  15. Remagnino P., Shihab A. and Jones G. (2004). Distributed intelligence for multi-camera visual surveillance. Pattern Recogn. 37(4): 675–689

    Article  Google Scholar 

  16. Svoboda T., Martinec D. and Pajdla T. (2005). A convenient multi-camera self-calibration for virtual environments. Presence Teleop. Virtual Environ. 14(4): 407–422

    Article  Google Scholar 

  17. Svoboda, T., Martinec, D., Pajdla, T., Bouguet, J.Y., Werner, T., Chum, O.: Multi-Camera Self-Calibration. Czech Technical University, Prague, Czech Republic. http://cmp.felk.cvut. cz/svoboda/SelfCal/

  18. Trivedi M.M., Gandhi T. and Huang K.S. (2005). Distributed interactive video arrays for event capture and enhanced situational awareness. IEEE Intell. Sys. Spec. Issue AI Homeland Security 20(5): 58–66

    Google Scholar 

  19. Trivedi M.M., Huang K.S. and Mikic I. (2005). Dynamic context capture and distributed video arrays for intelligent spaces. IEEE Trans. Syst. Man Cybern. Part A 35(1): 145–163

    Article  Google Scholar 

  20. Utsumi, A., Tetsutani, N.: Human tracking using multiple-camera-based head appearance modeling. In: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, pp.657–662 (2004)

  21. Velastin S.A., Boghossian B.A., Lo B., Sun J. and Vicencio-Silva M.A. (2005). Prismatica: Toward ambient intelligence in public transport environments. IEEE Trans. Syst. Man Cybern. Part A 35(1): 164–182

    Article  Google Scholar 

  22. Wu, T., Matsuyama, T.: Real-time active 3D shape reconstruction for 3D video. In: Proceedings of 3rd International Symposium on Image and Signal Processing and Analysis, vol. 1, pp. 186–191 (2003)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tarak Gandhi.

Additional information

This work has been sponsored by the Technical Support Working Group (TSWG) of US Department of Defence (DoD).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gandhi, T., Trivedi, M.M. Person tracking and reidentification: Introducing Panoramic Appearance Map (PAM) for feature representation. Machine Vision and Applications 18, 207–220 (2007). https://doi.org/10.1007/s00138-006-0063-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-006-0063-x

Keywords

Navigation