Skip to main content
SpringerLink
Log in

Memory-based cognitive modeling for robust object extraction and tracking

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Inspired by the way humans perceive the environment, in this paper, we propose a memory-based cognitive model for visual information processing which can imitate some cognitive functions of the human brain such as remembering, recall, forgetting, learning, classification, and recognition, etc. The proposed model includes five components: information granule, memory spaces, cognitive behaviors, rules for manipulating information among memory spaces, and decision-making processes. Three memory spaces are defined for separately storing the current, temporal and permanent information acquired, i.e. ultra short-term memory space (USTMS), short-term memory space (STMS) and long-term memory space (LTMS). The proposed memory-based model can remember or forget what the scene has ever been which helps the model adapt to the variation of the scene more quickly. We apply the model to address two hot issues in computer vision: background modeling and object tracking. A memory-based Gaussian mixture model (MGMM) for object segmentation and a memory-based template updating (MTU) model for object tracking with particle filter (PF) are exhibited respectively. Experimental results show that the proposed model can deal with scenes with sudden background and foreground changes more robustly when segmenting and tracking moving objects under complex background.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Lin JH (1994) A theory for memory-based learning. Mach Learn 17:143–167

    MATH  Google Scholar 

  2. Wang Y, Chiew V (2010) On the cognitive process of human problem solving. Cognitive Systems Research 11(1):81–92

    Google Scholar 

  3. Putze F, Schultz T (2009) Cognitive memory modeling for interactive systems in dynamic environments. In: 1st international workshop on spoken dialog systems (IWSDS2009), Kloster Irsee, Germany

    Google Scholar 

  4. Dinerstein J, Egbert PK, Garis H, Dinerstein N (2004) Fast and learnable behavioral and cognitive modeling for virtual character animation. Comput Animat Virtual Worlds 15:95–108

    Article  Google Scholar 

  5. Yang Z, Fan Y, Zhang B, Cheng X (2010) A computation memory model with human memory features for autonomous virtual humans. In: Proceedings of international conference on computer application and system modeling (ICCASM 2010), vol 3, pp 246–250

    Google Scholar 

  6. Ai DM, Ban XJ, Zhang SJ (2007) Cognitive modeling of artificial fish learning and memory. In: Proceedings of the 12th international symposium on artificial life and robotics (AROB 12th’07), pp 280–283

    Google Scholar 

  7. Ho WC, Dautenhahn K, Lim MY, Casse KD (2010) Modeling human memory in robotic companions for personalization and long-term adaptation in HRI. In: Proceedings of the first annual meeting of the biologically inspired cognitive architecture (BICA) society, Washington, DC, USA, pp 64–71

    Google Scholar 

  8. Gnjatović M, Janev M, Delić V (2012) Focus tree: modeling attentional information in task-oriented human-machine interaction. Appl Intell 37(3):305–320

    Article  Google Scholar 

  9. Huang S, Sadek Adel W (2009) A novel forecasting approach inspired by human memory: the example of short-term traffic volume forecasting. Transp Res, Part C, Emerg Technol 17:510–525

    Article  Google Scholar 

  10. James W (1890) Principles of psychology. Holt, New York

    Book  Google Scholar 

  11. Atkinson RC, Shiffrin MR (1968) Human memory: a proposed system and its control processes. In: Spence KW (ed) The psychology of learning and motivation, vol 2. Academic Press, New York, pp 89–195

    Google Scholar 

  12. Baddeley AD, Hitch GJ (1974) Working memory. In: Bower GH (ed) The psychology of learning and motivation, vol 8, pp 47–89

    Google Scholar 

  13. Wang Y, Wang Y (2006) Cognitive informatics models of the brain. IEEE Trans Syst Man Cybern, Part C, Appl Rev 36(2):203–207

    Article  Google Scholar 

  14. Wang Y (2009) Formal description of the cognitive process of memorization. In: Transactions of computational science V, pp 81–98

    Chapter  Google Scholar 

  15. Eysenck MW, Keane MT (2010) Cognitive psychology: a student’s handbook, 6th edn. Psychology Press, New York

    Google Scholar 

  16. Morgan H (2004) Real learning: a bridge to cognitive neuroscience. R&L Education

  17. Skowron A, Stepaniuk J (2001) Information granules: towards foundations of granular computing. Int J Intell Syst 16(1):57–85

    Article  MATH  Google Scholar 

  18. Julius HM, Ali Akber DM, Chae O (2012) A flexible edge matching technique for object detection in dynamic environment. Appl Intell 36(3):638–648

    Article  Google Scholar 

  19. Mirghasemi S, Yazdi HS, Lotfizad M (2012) A target-based color space for sea target detection. Appl Intell 36(4):960–978

    Article  Google Scholar 

  20. Piccardi M (2004) Background subtraction techniques: a review. In: Proceedings of IEEE international conference on systems, man and cybernetics, Hague, Netherlands, pp 3099–3104

    Google Scholar 

  21. Stauffer C, Grimson W (1999) Adaptive background mixture models for real-time tracking. In: Proceedings of IEEE conference on computer vision and pattern recognition, Ft Collins, CO, USA, pp 246–252

    Google Scholar 

  22. Stauffer C, Grimson W (2000) Learning patterns of activity using real-time tracking. IEEE Trans Pattern Anal Mach Intell 22(8):747–757

    Article  Google Scholar 

  23. Popović B, Janev M, Pekar D, Jakovljević N, Gnjatović M, Sečujski M, Delić V (2012) A novel split-and-merge algorithm for hierarchical clustering of Gaussian mixture models. Appl Intell 37(3):377–389

    Article  Google Scholar 

  24. Lee DS (2002) Improved adaptive mixture learning for robust video background modeling. In: Proceedings of IAPR workshop on machine vision applications, Nara-ken New Public Hall, Nara, Japan, pp 443–446

    Google Scholar 

  25. Lee DS (2005) Effective Gaussian mixture learning for video background subtraction. IEEE Trans Pattern Anal Mach Intell 27(5):827–832

    Article  Google Scholar 

  26. Yilmaz A, Javed O (2006) Object tracking: a survey. ACM Comput Surv 38(4):1–45

    Article  Google Scholar 

  27. Gordon NJ, Salmond DJ, Smith AFM (1993) Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE Proc F, Radar Signal Process 140(2):107–113

    Article  Google Scholar 

  28. Arulampalam MS, Maskell S, Gordon N, Clapp T (2002) A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans Signal Process 50(2):174–188

    Article  Google Scholar 

  29. Zhou SK, Chellappa R, Moghaddam B (2004) Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Trans Image Process 13(11):1491–1506

    Article  Google Scholar 

  30. Li AP, Jing ZL, Hu SQ (2007) Robust observation model for visual tracking in particle filter. AEÜ, Int J Electron Commun 61(3):186–194

    Article  Google Scholar 

  31. Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–577

    Article  Google Scholar 

  32. BMP image sequences for elliptical head tracking. http://www.ces.clemson.edu/~stb/research/headtracker/seq

  33. Shadow detection. http://cvrr.ucsd.edu/aton/shadow/

Download references

Acknowledgements

The paper is funded by the National Natural Science Foundation of P.R. China (No. 60873163, No. 61271407), and the Fundamental Research Funds for the Central Universities (No. 27R1105019A).

Author information

Authors and Affiliations

  1. College of Information and Control Engineering, China University of Petroleum, No. 66, Changjiang West Road, Economic and Technological Development Zone, Qingdao, 266580, China

    Yanjiang Wang & Yujuan Qi

Authors
  1. Yanjiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yujuan Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yujuan Qi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, Y., Qi, Y. Memory-based cognitive modeling for robust object extraction and tracking. Appl Intell 39, 614–629 (2013). https://doi.org/10.1007/s10489-013-0437-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-013-0437-5

Keywords

Search

Navigation