Skip to main content
SpringerLink
Log in

Trail optimization framework to detect nonlinear object motion in video sequences

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Detecting and tracking multiple moving objects in a sequence of video images is an important application in automated surveillance systems, service robots, target discrimination, traffic monitoring, etc. Since these systems require real-time processing, providing an efficient method with lower computational complexity is a challenge. Besides the combination of rudimentary techniques which works well for linear objects, this paper presents an operative technique to recognize and track multiobject moving in a video sequence without using additional trackers. Instead of processing the entire video sequence, candidate keyframes are identified and the foreground moving objects are detected. To solve the nonlinear tracking problem, this paper presents an optimized twin algorithm—amended Kalman with Hungarian algorithm—to track multiple moving objects on their center of gravity in the minimal bounding box. Kalman filter predicts the location of the foreground objects in various orientation bins to extract the short-term movement of the foreground objects in possible trajectory paths. Hungarian algorithm locates the presence/absence of nonlinear objects in the tracks. Location prediction and tracking of moving objects only on the candidate frames reduces the computation time. Therefore, it is a good alternative method for nonlinear motion estimation that is likely required for multiobject identity tracking in image sequences. This approach achieves high accuracy and reduces additional computations comparable to state-of-the-art online trackers. The comparison also proved that the proposed method has better precision–recall values with computation simplicity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Hu, W., Tan, T., Wang, L., Maybank, S.: A survey on visual surveillance of object motion and behaviors. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 34(3), 334–352 (2004)

    Article  Google Scholar 

  2. Tippaya, S., Suchada, S., Tan, T., Khan, M.M., Chamnongthai, K.: Multi-modal visual features based video shot boundary detection. IEEE Access 5, 12563–12575 (2017)

    Article  Google Scholar 

  3. Mohan, A.S., Resmi, R.: Video image processing for moving object detection and segmentation using background subtraction. In: Proceedings of International Conference on Computational Systems and Communications, vol. 01(01), pp. 288–292 (2014)

  4. Hampapur, A., Brown, L., Connell, J., Ekin, A., Haas, N., Lu, M., Merkl, H., Pankanti, S.: Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking. IEEE Spat. Process. Mag. 22(2), 38–51 (2005)

    Article  Google Scholar 

  5. Zhang, S., Wang, C., Chan, S.-C., Wei, X., Ho, C.-H.: New object detection, tracking, and recognition approaches for video surveillance over camera network. IEEE Sens. J. 15(5), 2679–2691 (2015)

    Article  Google Scholar 

  6. Luo, J., Papin, C., Costello, K.: Towards extracting semantically meaningful key frames from personal video clips: from humans to computers. IEEE Trans. Circuits Syst. Video Technol. 19(2), 289–301 (2009)

    Article  Google Scholar 

  7. Kalman, R.E.: New approach to linear filtering and prediction problems. J. Basic Eng. 82, 35–45 (1960)

    Article  MathSciNet  Google Scholar 

  8. Yoon, Y., Kosaka, A., Kak, A.C.: A new Kalman-filter based framework for fast and accurate visual tracking of rigid objects. IEEE Trans. Robot. 24(5), 1238–1251 (2008)

    Article  Google Scholar 

  9. Pan, J., Hu, B., Zhang, J.Q.: Robust and accurate object tracking under various types of occlusions. IEEE Trans. Circuits Syst. Video Technol. 18(2), 223–236 (2008)

    Article  Google Scholar 

  10. Liang, C.-W., Juang, C.-F.: Moving object classification using a combination of static appearance features and spatial and temporal entropy values of optical flows. IEEE Trans. Intell. Transp. Syst. 16(6), 3453–3464 (2015)

    Article  Google Scholar 

  11. Kuhn, H.W.: The Hungarian method for the assignment problem. Naval Res. Logist. Q. 2, 83–97 (1995)

    Article  MathSciNet  Google Scholar 

  12. Verma, K., Kumar, A., Ghosh, D.: Robust stabilised visual tracker for vehicle tracking. Def. Sci. J. 68(3), 307–315 (2018)

    Article  Google Scholar 

  13. Yin, H., Chai, Y., Yang, S.X., Yang, X.: Fast-moving target tracking based on mean shift and frame-difference methods. J. Syst. Eng. Electron. 22(4), 587–592 (2011)

    Article  Google Scholar 

  14. Duffner, S., Garcia, C.: Fast pixelwise adaptive visual tracking of non-rigid objects. IEEE Trans. Image Process. 26(5), 2368–2380 (2017)

    Article  MathSciNet  Google Scholar 

  15. Lingaswamy, S., Kumar, D.: An efficient moving object detection and tracking system based on fractional derivative. Multimed. Tools Appl. 77(8), 1–19 (2018)

    Google Scholar 

  16. Ghosh, A., Subudhi, B.N., Ghosh, S.: Object detection from videos captured by moving camera by fuzzy edge incorporated Markov random field and local histogram matching. IEEE Trans. Circuits Syst. Video Technol. 22(8), 1127–1135 (2012)

    Article  Google Scholar 

  17. Antoniou, C., Ben-Akiva, M., Haris, N.K.: Nonlinear Kalman filtering algorithms for on-line calibration of dynamic traffic assignment models. IEEE Trans. Intell. Transp. Syst. 8(4), 661–670 (2007)

    Article  Google Scholar 

  18. Yu, Y.K., Wong, K.H., Chang, M.M.Y.: Recursive three-dimensional model reconstruction based on Kalman filtering. IEEE Trans. Syst. Man Cybern. Part B 35(3), 587–592 (2005)

    Article  Google Scholar 

  19. Mendonca, P.R.S., Wong, K.-Y.K., Cipolla, R.: Epipolar geometry from profiles under circular motion. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 604–616 (2001)

    Article  Google Scholar 

  20. Wan, Y., Huang, Y., Buckles, B.: Camera calibration and vehicle tracking: Highway traffic video analytics. Transp. Res. Part C 44, 202–213 (2014)

    Article  Google Scholar 

  21. Hamuda, E., Ginley, B.M., Glavin, M., Jones, E.: Improved image processing-based crop detection using Kalman filtering and the Hungarian algorithm. Comput. Electron. Agric. 148, 37–44 (2018)

    Article  Google Scholar 

  22. Priya, L.G.G., Domnic, S.: Video cut detection using block-based histogram differences in RGB color space. In: Proceedings of the International Conference Signal and Image Processing, pp. 29–33 (2010)

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, Tamil Nadu, India

    T. Manonmani & Vijayakumari Pushparaj

Authors
  1. T. Manonmani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vijayakumari Pushparaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to T. Manonmani.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Manonmani, T., Pushparaj, V. Trail optimization framework to detect nonlinear object motion in video sequences. SIViP 14, 537–545 (2020). https://doi.org/10.1007/s11760-019-01581-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01581-7

Keywords

Search

Navigation