Skip to main content
Log in

Active tracking and pursuit under different levels of occlusion: a two-layer approach

  • Full Length Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

We present an algorithm for real-time, robust, vision-based active tracking and pursuit. The algorithm was designed to overcome problems arising from active vision-based pursuit, such as target occlusion. Our method employs two layers to deal with occlusions of different lengths. The first layer is for short- or medium-term occlusions: those where a known method—such as mean shift combined with a Kalman filter—fails. For this layer we designed the hybrid filter for active pursuit (HAP). HAP utilizes a Kalman filter modified to respond to two different modes of action: one in which the target is positively identified and one in which the target identification is uncertain. For long-term occlusions we use the second layer. This layer is a decision algorithm that follows a learning procedure and is based on game theory-related reinforcement (Cesa-Bianchi and Lugosi, Prediction Learning and Games, 2006). The learning process is based on trial and error and is designed to perform adequately with a small number of samples. The algorithm produces a data structure that can be shared among agents or sent to a central control of a multi-agent system. The learning process is designed so that agents perform tasks according to their skills: an efficient agent will pursue targets while an inefficient agent will search for entering targets. These capacities make this system well suited for embedding in a multi-agent control system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Bar-Shalom, Y., Li, X.R., Kirubarajan, T.: Estimation with Applications to Tracking and Navigation. Wiley, New York (2001)

    Book  Google Scholar 

  2. Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit. 2, 142–151 (2000)

  3. Gustafsson, F., Gunnarsson, F., Bergman, N., Forssell, U., Jansson, J., Karlsson, R., Nordlund, P.J.: Particle filters for positioning, navigation and tracking. IEEE Trans. Signal Process. 50(2), 425–437 (2002)

    Article  Google Scholar 

  4. Van Der Merwe, R., Wan, E.: The square-root unscented Kalman filter for state and parameter-estimation. IEEE Int. Conf. Acoust. Speech Signal Process. 6, 3461–3464 (2001)

    Google Scholar 

  5. Sinopoli, B., Schenato, L., Franceschetti, M., Poolla, K., Jordan, M.I., Sastry, S.S.: Kalman filtering with intermittent observations. IEEE Trans. Autom. Control 49(9), 1453–1464 (2004)

    Google Scholar 

  6. Cesa-Bianchi, N., Lugosi, G.: Prediction Learning and Games. Cambridge University Press, Cambridge (2006)

    Book  MATH  Google Scholar 

  7. Rabiner, L.R., Juang, B.H.: An introduction to hidden Markov models. IEEE Acoust. Speech Signal Process. Mag. 3(1), 4–16 (1986)

    Google Scholar 

  8. Schapire, R.E.: A brief introduction to boosting. Int. Joint Conf. Artif. Intell. 16(2), 1401–1406 (1999)

    Google Scholar 

  9. Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8, 279–292 (1992)

    MATH  Google Scholar 

  10. Durham, W., Franchi, A., Bullo, F.: Distributed pursuit-evasion without mapping or global localization via local frontiers. Auton. Robots 32, 81–95 (2012)

    Article  Google Scholar 

Download references

Acknowledgments

The authors deeply thank Orly and Daniel Ghosalker for their contribution to the machine learning section, Daniel Sigalov for his constructive remarks, and Amir Geva for the programming of NEMALA. Gadi Katzir was supported during the writing by an ISF grant. Tomer Baum thanks Boreh Olam for everything.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tomer Baum.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Baum, T., Izhaki, I., Rivlin, E. et al. Active tracking and pursuit under different levels of occlusion: a two-layer approach. Machine Vision and Applications 25, 173–184 (2014). https://doi.org/10.1007/s00138-013-0520-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-013-0520-2

Keywords

Navigation